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INTRODUCTION 



Chapter 1 



Introduction 



Cooperative phenomena is an ordinary pattern in various part of science where interact- 
ing entities attempt to satisfy some optimal conditions. Such kind of behaviour is observable 
in equilibrium physics where the degree of cooperation can be characterized by macroscopic 
functions but cooperation could emerge in out of equilibrium systems also, like in sociology, 
economy, biology or physics etc., where the correlation evolves in the system when an entity 
aspire to satisfy personal optimal conditions and it is content to cooperate with other partici- 
pants for the sake of its cause. In this case we cannot characterize the system with macroscopic 
functions, but we can describe it on microscopic level. Even in different systems the correlative 
agents are defined differently but their behaviour presents universal attributes. In this sense the 
complexity of a system can be defined by its interconnected features arising from properties of 
its individual parts. Such parts could be either which govern the interactions or the dynamical 
rules to control the time evolution or the backgrounding structure which also can influence the 
system behaviour. This kind of combined effects leads to a complex system with non-trivial 
cooperative behaviour and brings on many interesting questions which give the motivation for 
advanced studies. 

Correlated systems can be examined efficiently within the frame of statistical physics. The 
subject of this area is to study systems which depend on random variable, and describe their 
behaviour obtained from large number of observation using physical terminology. An interesting 
subject of this segment is the one of phase transitions which has been intensively studied since 
the beginning of the 20th century Phase transitions occur in many part of Nature where 
counteractive processes compete to determine the state of the system controlled by an external 
parameter. The best-known examples in physics are the liquid-vapor or the ferromagnetic- 
paramagnetic phase transitions but similar behaviour can be observed in model systems like in 
different spin models, in epidemic spreading problems or in critical percolation. 

The first relevant approach was the mean field theory which gave a phenomenological de- 
scription of phase transitions and critical phenomena and is capable to describe a wide range 
of model systems. It was first defined by Pierre Weiss in 1907 for ferromagnetic systems where 
he assumed that the spins interact with another through a molecular field, proportional to the 
average magnetization [1]. This molecular field approximation method neglects the interactions 
between particles and replaces them with an effective average field which enables to simplify the 
solution of the problem. At the same time the disadvantage of the method originates from the 
average molecular field also, since it neglects any kind of fluctuations in the system. Therefore 
the mean field approximation is valid only in higher dimensional systems or in erase of models 
where the fluctuations are not important. 

One of the simplest and most elegant mean field speculations concerning the possible general 
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form of a thcrmodynamical potential near to the critical point was introduced later by Lev. D. 
Landau [2,3] in 1936. The Landau theory allows a phenomcnological reproduction of continuous 
phase transitions based on the symmetry of the order parameter. He assumed that the free 
energy can be expanded as a power series of the order parameter where the only terms which 
contribute are the ones compatible with the symmetry of the system. 

The observation that the correlation length diverges at the phase transition point and the 
fluctuations in the system are self-similar in every length scale, led to the recognition of scale 
invariant behaviour of critical systems. The first comprehensive mathematical approach of 
such phenomena was given by Leo Kadanoff in the 1960s [4,5]. A few years later in the 
beginning of the 1970s based on his results, Kenneth G. Wilson gave the relevant discussion 
of the subject in his celebrated papers [6,7]. He introduced the renormalization group theory 
which serves predictions about critical behaviour in agreement with experimental results and 
give a possibility to categorize critical systems into universality classes due to them singular 
behaviour. His investigations were awarded with a Nobel prize in 1982. 

In the beginning of the 1970s another theory emerged which completed the knowledge about 
the universal behaviour around the criticality. The conformal field theory was firstly investigated 
by Polyakov [8] , who capitalized that the group of conformal mappings is equivalent to the group 
of complex analytical functions in two dimensions [9,10]. Exploiting this property and the scale 
invariant behaviour, the partition function of a critical system is derivable which leads to exact 
calculations of critical exponents. In the case of conform transformations the order parameter 
correlation functions can be calculated also which then enables to deduce the order parameter 
profiles along the system boundaries. 

As a first approximation generally the investigated system is assumed to be homogeneous, 
which condition simplifies its study and the physical description. However, in Nature a sub- 
stance is often characterized by certain degree of inhomogeneity which could perturb its critical 
behaviour [11]. Frequently stated examples of this abnormality, are the lattice defects and im- 
purities in crystals. In theoretical description this kind of feature is introduced by the concept 
of disorder which is defined as random distributed values of certain properties of the investi- 
gated disordered model. These random properties can be the strength of interaction, a random 
external field or can arises by random dilution. These properties are able to modify the critical 
features of the system as changing the order of phase transition or shift the critical point and 
exponents, thus transforming the model into a new universality class. 

However, inhomogeneity can arise from the geometrical structure of the backgrounding frame- 
work of materials also. Beyond solid-state physics where crystals have a regular geometry, 
many self-organizing media in the Nature can form random structures. Two Hungarian math- 
ematicians, Pal Erdos and Alfred Renyi defined the first related random graph model in their 
pioneering papers [12-14] in the beginning of the 1960s which was the origin of the new sci- 
ence of networks. However, as the informations of real world networks became available by 
the emergence of large databases, a deeper view into the underlying organizing principles sug- 
gested a more complex structure. In the beginning of the 1990s Barabasi, Albert and Jcong 
after they examined the structure of the World Wide Web found an algebraic decay of the 
network degree distribution. This observation made them realize the real rules which govern 
the evolution of such kind of complex networks. They defined a dynamical growing network 
model, the Barabasi- Albert model [15], where the sites are not connected homogeneously but 
follow a so-called preferential attachment rule leading to a scale-free graph with a power-law 
degree distribution. This model gave a very good approximation of real complex networks and 
became popular after many complex systems in science and technology were found to present 
the same structure [16]. This interdisciplinary behaviour which suggests universal rules behind 
self-organizing networks keeps this discipline to the frontline of science up to this day. 
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Analyzing a complex many body system was difficult earlier since generally these systems 
have large degrees of freedom and those could be in many possible states. However, by the 
improvement of computational engines new possibilities appeared and high precision numerical 
methods were developed to examine the relevant models. It was the base of the new discipline 
of numerical physics which then became the third pillar of the science beyond the experiments 
and theory. By using numerical calculations, the statistical description of many body systems 
became available which then led to a renaissance of the statistical physics. This relation induced 
the evaluation of Monte Carlo methods which provided special computational techniques for 
statistical physics simulations. 

One of the first and most frequently used method which is capable to simulate interacting 
spin systems is the Metropolis algorithm, introduced in 1953 [17]. This so-called single spin 
flip algorithm evaluate the system through a Markov chain where the system energy change 
depends on local configurations. However, some other algorithms of Swendsen-Wang [18] and 
Wolff [19] provided more efficient methods where instead of one-by-one spin flips, complete 
domains are turned in one step and evaluate the system faster toward its equilibrium. 

Beyond that, many other kind of statistical methods were developed in order to calculate 
some thermodynamical function using mathematical considerations. A recent algorithm which 
capitalize combinatorial optimization is capable to calculate exactly the free energy for models 
where the free energy function can be recognized as a submodular function [20,21]. This iterative 
method which provided results in strongly polynomial time was applied frequently in course of 
my work. 

My motivation during my PhD studies was to examine cooperative behaviour in complex 
systems using the methods of statistical and computational physics. The aim of my work was 
to study the critical behaviour of interacting many-body systems during their phase transitions 
and describe their universal features analytically and by means of numerical calculations. In 
order to do so I completed studies in different subjects which are presented in the thesis in the 
following order: 

After this introduction in the second chapter we summarize the capital points of the related 
theoretical results. We shortly discuss the subjects of phase transitions and critical phenomena 
and briefly write about the theory of universality classes and critical exponents. Then we 
introduce the important statistical models which will be examining later in the thesis. We close 
this part with a description of disordered models which will be helpful during later discussions. 

In the third chapter first, we point out the definitions of graph theory that we need to 
introduce the applied geometrical structures. Then we review the main properties of regular 
lattices and define their general used boundary conditions. We close this chapter with a short 
introduction to complex networks. 

The fourth chapter contains the applied numerical methods that we used in the course of 
numerical studies. We write a few words about Monte Carlo methods and introduce a combi- 
natorial optimization algorithm and its mathematical background. As a last point we describe 
our own technique to generate scale-free networks. 

In the fifth chapter we consider nonequilibrium phase transitions, such as epidemic spreading, 
in weighted scale-free networks, in which highly connected nodes have a relatively smaller ability 
to transfer infection. We solve the dynamical mean-field equations and discuss finite-size scaling 
theory. The theoretical predictions are confronted with the results of large scale Monte Carlo 
simulations on the weighted Barabasi- Albert network. 

In the sixth chapter we examine the ferromagnetic large-q state Potts model in complex 
evolving networks, which is equivalent to an optimal cooperation problem, where the agents 
try to optimize the total sum of pair cooperation benefits and the supports of independent 
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projects. We study the critical behaviour on Barabasi-Albert networks in case of homogeneous 
couplings and consider the effects of bond disorder by the magnetization behaviour. We locate 
the phase transition point and some critical exponents using the shift of the distribution of 
finite-size transition points. We also examine the structural evolution of the largest cluster. 

The seventh chapter contains our consideration of the classical random bond Potts model in 
the large-q limit with disorder-dominated critical points and study the distribution of clusters 
that are confined in strips and touch one or both boundaries. We study optimal Fortuin- 
Kastelcyn clusters using the combinatorial optimization algorithm and obtain accurate numer- 
ical estimates for the critical exponents and demonstrate that the density profiles arc well 
described by conformal formulas. 

In the eighth chapter we study the antifcrromagnetic Ising model on triangular lattice at 
zero temperature. We consider its critical dynamical behaviour in the aging regime and search 
for proof to decide that its non-equilibrium behavior is governed by a diffusive growth with 
logarithmic correction or if it follows a subdiffusive behaviour with an effective dynamical 
exponent. In order to do so, we define a quantity which depends exclusively on the dynamical 
exponent and that is capable to recognize the true dynamical behaviour. We also examine the 
scaling of the two-time autocorrelation function in equilibrium and in the aging regime. 

During my PhD studies I investigated another subject where I examined the mapping be- 
tween the surface behaviour of the random bond Potts model and random field Ising model 
in two dimensions. The surface mapping between the two systems was expected to be exact 
following from some theoretical consideration [22], which was partly confirmed by the numerical 
calculations, however these results are not included into this current paper. 

The new results presented in this work are published in [23-25] or their publication is in 
progress [26]. 
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Chapter 2 

General Overview 



2.1 Phase transitions and critical phenomena 

A material pass through a phase transition when it is transformed between its different 
macroscopic phases and its properties change controlled by an external parameter. The type 
of the phase transition is related to the order of the transition which was defined by Ehrcnfest 
as the singularity of the free energy or one of its derivatives. This singularity takes place at a 
critical value of the external control parameter where the phase transition arises and separates 
the macroscopic phases in the phase space. In completely different systems, thermodynamic 
properties show the same critical behavior at the vicinity of their phase transition point, which 
kind of behaviour is related to the subject of universality and critical phenomena. In the 
following chapter we are going to discuss briefly the theory of phase transitions and critical 
phenomena, define some models which are of general importance or which are related to the 
following problems. 



2.1.1 Ferromagnetic phase transition 

In ferromagnetic materials the equilibrium phase depends on the external field H and the 
temperature T. These quantities control the macroscopic behavior of the system [27]. The 
magnetization M plays the order parameter role and enables to identify the different phases 
of the system. In ferromagnets varying H or T, two kind of phase transition can be identified 
following different orders. 

The first phase transition happens at low temperature between two separated macroscopic 
phases, where the sign of M is either positive or negative determined by the dominant spin 
direction. The external field controls the phase transition. Changing H at a critical point 
H c = 0, the ferromagnet jumps from one of its macroscopic ground state to the other, the 
magnetization immediately changes sign and the system goes through a sharp phase transition. 



Since the magnetization, which is the first derivative of the free energy (see in Section 2.2.1 1, 
is discontinuous at the critical point this phase transition is of first-order. 

The second phase transition happens if we keep H — and increase the temperature from 



zero and following the critical phase coexisting line (Fig 2.1). The spontaneous magnetization 
decreases until a critical temperature T c is reached where it smoothly vanishes out and goes to 
zero. The system at this critical temperature (also called Curie-temperature), looses its ferro- 
magnetic properties and enters the paramagnetic phase through a continuous phase-transition 
(Fig|2.1|. If T > T c the system can be transformed from the field driven up to driven down 



5 



GENERAL OVERVIEW 



phase and vica versa without any phase transition since the magnetization is zero and there is 
no fundamental difference between the two region (Fig|2.1|. 




Figure 2.1: Phase diagram of the two dimensional Ising ferromagnet. Below T c the system paths 
through a first order phase transition driven by the external field H . Here at H — the magnetization 
mo(H) is discontinuous. On the critical line H = another phase transition of second order occurs at 
T c which above the magnetization is zero. 



2.1.2 A microscopic model 

To understand better the magnetic behaviour of the system at different phases we need to 
study it on a microscopic level. To do so we define the general Ising model which enables us to 
illustrate the behavior of magnetic spins at different macroscopic phases and during the phase 
transition. 

Consider a (i-dimensional hypcrcubic lattice, where at each site i a spin cr, is present. All spins 
can take a value of <7j — ±1 and interact only with their nearest neighbours by an exchange 
interaction J. The Hamiltonian of the Ising model is 

(id) 

where the summation runs over all spin pairs of nearest neighbours. If the exchange 

interaction J > 0, neighbouring spins favor to align in the same direction, driving ferromagnetic 
order into the system. The order parameter is the average magnetization per site defined as 
m = 1/L d Oi where L is the linear size of the system and where the sum goes over all spins. 
This model has been defined and solved in 1925 by Ising [28] in one dimension, where the system 
does not show any phase transition for T > since it does not have any stable ordered phase. 
However an exact solution exists in two dimension by Onsager [29] in absence of external field, 
where the phase diagram is the same as for ferromagnet s. In three or higher dimensions the 
Ising model is still not solved analytically however many precise numerical result exist about 
the critical point and exponents. 
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2.1.3 Critical phenomena 

Critical phenomena takes place at the critical point of a continuous phase transition, when the 
correlation length diverges. Different thermodynamical quantities follow singular behaviors and 
are connected by scaling relations [30] . To discuss such phenomena, we study the ferromagnetic- 
paramagnetic continuous phase transition from the point of view of the two dimensional Ising 
model on a microscopic scale. To do so we analyze an "Ising system" in the thermodynamical 



limit, when the system size tends to infinity. We follow the zero field line (Fig 2.1), vary the 



temperature and measure the spin-spin correlation length. The correlation length £ (for exact 



definition see Section 2.2.11 represents the degree of correlation at a given temperature and it 
can be measured like the linear size of the largest magnetic domain. 

We start from T = oo limit, where the system is completely disordered and £ = 0, since the 
magnetic order is destroyed by thermal fluctuations. Decreasing T though, but keeping it above 
T c , the exchange interactions become more dominant and the neighbouring spins try to align 
parallel. Even thermal fluctuations influence the system down to the scale of lattice-spacing, 
local magnetic domains evolve and correlation appears in short range order. Accordingly the 
correlated spin clusters grow and the correlation length becomes finite £ > and increases as 
the temperature approaches T c . 

The critical temperature T c is located at the point where the correlation length becomes 
infinite. At the same time some thermodynamical properties of the system denote singular 
power-law behaviors characterized by a set of exponents which enables us to classify critical 
systems. This critical phenomena will be the subject of the next section. 

At the vicinity of the critical point, fluctuations become more relevant up to the correlation 
length scale. These fluctuations are correlated and self-similar, so the system shows the same 
structure from the lattice constant scale up to £, independently of the scaling resolution. Since 
the correlation length turns to be infinite at T c the critical system becomes scale-invariant. This 
causes a fractal like structure for the dominant ordered cluster which now spreads all over the 
system on every length scale. 

After the system tries to leave its critical phase as we decrease the temperature, a spontaneous 
symmetry breaking appears at T c since the system must choose to evaluate into the up or down 
spin state. This explains the symmetrical behavior of the magnetization below T c presented 
in the (Fig |2.1| . Below T c the system is in the long-range order ferromagnetic phase, and 
the correlation contribution to energy becomes more significant than the entropic one. The 
magnetization moves off from M = and increases until its saturation value at T — where 
only the exchange interaction dominates and the systems becomes completely ordered. 



2.2 Universality classes and critical exponents 

At the vicinity of the critical point, various thermodynamical properties follow singular be- 
haviors. This non-analytical attribute is characterized by a set of critical exponents, allows us 
to compare and classify phase transitions in different physical systems. These critical expo- 
nents appear only at the critical point of second order phase transition and fall into a limited 
number of universality classes, featured fairly different systems driven by the same fundamental 
symmetries [31,32]. In the following we are going to define thermodynamical quantities and 
the related critical exponents to analyze universal behaviors. 
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2.2.1 Thermodynamical quantities 

The partition function of a canonical statistical is system given by: 

Z(T,H) = Y j e~ 0E » (2-2) 

where the sum runs over all the possible microscopic states. Each microscopic states with 
energy appears with the probability = e~ /3E " jZ where the thermal term is introduced 
as (i — 1/ksT, also called inverse temperature and ks denotes the Boltzmann constant. Then 
we define the free energy to be proportional to the logarithm of the partition function: 

f(T,H) = -k B Tln(Z) and f(T,H) = —ksT lim L~ d \n(Z) (2.3) 

L — >oo 

where f(T, H) denotes the free energy density which gives the energy of one particle in the 
system since it is normalized with the system size. All the thermodynamical quantities could 
be defined then by the partition function and the free energy or one of its derivative. The 
magnetization is given at constant temperature by: 

f9J 7 \ (dM\ , n A . 

M =-ll^) - XT=[ inF ) (2.4) 

T 



where xt is the magnetic response function or magnetic susceptibility at constant temperature. 
The internal energy arises as the derivative of the logarithm of the partition function: 

V=-l-M-) . C H = —) (2.5) 



\ d/3 J ' " \dT J H 

where Ch is the thermal response function or the specific heat at constant H field. The entropy 
of the all system is given also at constant field by: 

where Cum gives the specific heat at constant field and magnetization. 

The above presented thermodynamical parameters give an image of the system on a macro- 
scopic scale. However to understand better the behavior of phase transitions it is crucial to 
follow the evolution on a microscopic level. The connected correlation function gives a chance 
for that, since it measures how local fluctuations affect different parts of the system. It is in- 
troduced as a measure of the spin-spin correlation between two spins <Tj and <jj at the position 
fj and fj separated by distance r = |fj — fj\. 

T(n, fj) = r itj = ((a, - (a^iaj - (a,))) (2.7) 

where (...) denotes the thermal average. If the system is in the short-range order the correlation 
function decays rapidly and spin fluctuations at large distance do not show any correlation. 
However if the decay of the correlation function is slow, fluctuations are correlated through 
a long distance and the system is in the long-range order. If the system is symmetric under 
spatial translations, then (<7j) = (aj) and the correlation function depends only on the spatial 
distance r, so 

r 4 ,,=r(r) = (^>-(a> 2 (2.8) 
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Above the critical temperature T > T c , spins are correlated only on short distance and the 
correlation decays exponentially as: 

r(r) = r-( d - 2 +"V r /« (2.9) 

here £ defines the correlation length which is supposed to be rotational invariant near the critical 
point for large r distance. In the power of r, d denotes the spatial dimension and the exponent 
77 features critical singularity of the correlation function which will be treated in the following 
part. 

All these thermodynamical parameters that we defined above are calculated by their expected 
value in statistical thermodynamics which for an arbitrary Y are quantity defined as: 

( 7 >4^ r " e "^ (2 - io) 

A" 

where denotes the value of the quantity Y for the spin configuration fi with energy E^. 



2.2.2 Critical point exponents and Universality 

In continuous phase transitions close to the critical point, the correlation function becomes 
infinite and the second derivatives of the thermodynamical potential diverge [33] . In magnetic 
systems the free energy plays the potential role and the divergent parameters are the specific 
heat and the zero field susceptibility. This behavior strongly depends on the distance to the 
criticality controlled by some scaling fields like the reduced temperature t and the reduced 
magnetic field h defined as: 

t= T ^ and h=-^- (2.11) 

T c K B ±c 

Then the critical behavior of an arbitrary continuous and positive Y{i) thermodynamical func- 
tion can be characterized with its critical exponent 

e = lim l^fflll where Y(t) ~ \t\ e (2.12) 

This pure power-law behavior however does not appear in this clear form, but more generally 

Y(t) = A\t\ t (l + Bt tl +---) , £l >0 (2.13) 

where, close to the critical point, only the leading term dominates. This exponent is measurable 
and suitable to describe the behavior of the thermodynamical parameters at the vicinity of the 
phase transition point, while the whole function might not be. Since in fcrromagnets the system 
passes through a continuous phase transition if h — and t — 0, the singular behavior can be 
recognized as keeping one of the scaling field at zero and studying the thermodynamical behavior 
varying the other field around the critical point. If h = and the temperature approach T c , 
the zero-field magnetization, the isothermal susceptibility, the specific heat and the zero-field 
correlation length diverge as: 

M{t)~{-tf , X H(t)~\t\-~< , c H (t)~\t\- a , e~i*r ( 2 - 14 ) 



However following the t = critical isothermal curve on the H — M plane (Fig 2.1 1, the 



magnetization and the correlation length decays as a power law around h ~ introducing 
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critical exponents: 

M(h) ~ \h\^ 5 , m~\hr h (2.15) 



Finally the above described pair correlation function (Eq2.9) can be characterized with the 



exponent rj since at T c the exponential part vanishes so its asymptotic behavior is: 

I\r) ~ r - (d - 2+ ^ (2.16) 

Following from experiments the short range interacting systems, which have the same di- 
mensions and order parameter symmetries, show the same critical exponents. This universal 
behavior enables us to compare drastically different and complex physical systems and define 
simple models with the same fundamental properties to analyze their behavior in a simpler way. 
These systems with similar critical exponents are conjugated to universality classes, which are 
labeled by the simplest theoretical model belonging to the same universality class. 

2.2.3 Scaling Hypothesis 

At the critical point the correlation length is infinite and the system is self-similar on every 
length scale. This scale invariant character and the homogeneous behavior of the divergent 
thermodynamical functions establishes the scaling hypothesis. 

Changing the length scale of a lattice system and increasing the lattice spacing r with a factor 
b > 1, the number N of spins is decreasing to N' , the degree of freedom is reducing and all the 
distance in the lattice are rescaled as r' = r/b where b d — j^. The spins which gather at the 
same block in the scaled system are replaced by their average value and the free energy density 
which was distributed on N sites initially, now belongs to N' sites and scales as f(v/b) = b d f(r). 

During this rescaling process the two scaling field t and h change by the factor b d ~ x where 
x is defined as the scaling dimension [34, 35] . This scaling dimension governs the displacement 
of the system in the parameter space. If d — x < 0, then the corresponding field is increased 
under rescaling and moves away the system from a fixed point which determines the universal 
behaviour of the system in the parameter space. This type of fields are called to be relevant 
since these are capable to change the critical behaviour of the system. However if d — x > 
the system approaches the fixed point, the critical exponents remain unchanged and the field 
is irrelevant. If d — Xi, called marginal field, then only higher order fields are important. The 
system becomes invariant under rescaling only when the relevant fields vanish which corresponds 
to a certain set of critical properties. Since irrelevant variables finally vanish under rescaling, 
only the relevant and marginal parameters influence the critical behavior and exponents. 

In second order phase transitions near to the fixed point the free energy density can be 
decomposed to a regular and a singular part as: 

f(t,h) = f reg (t,h) + f sing (t,h) (2.17) 

The regular term is analytical and can be neglected, however according to the scaling hypothesis 
[5,36-38] the singular part of the free energy density can be written as a homogeneous function 
of the linear relevant scaling fields. For magnetic systems with short range interactions the two 
relevant scaling fields are the reduced temperature t and reduced external field h so the singular 
part of the free energy density inside a bulk behaves as: 

f b (t, h, l/L) ~ b- d J{b x /»t, b d ~ x »h, b/L) (2.18) 

where v and x\> define the scaling dimensions of the scaling fields of reduced temperature t and 
bulk magnetization field h respectively. In Eq 2.18| we included the inverse of the linear size 
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of the system as a new relevant scaling field, since at its bulk critical point a system is truly 
critical only in the thermodynamical limit, i.e. when l/L = 0. 

Differentiating Eq |2.18| in both sides with respect to the field, following the definition Eq 2.4 
and by setting h = b/L = and b = t~ v , we get the scaling form for the magnetization: 

m(t, h, l/L) ~ t VXh rh{b l ' v t, b d - x "h, b/L) (2.19) 

_ i 

However if we set t = b/L = and b = h d - x b then the scaling of the magnetization with field 

m(t,h,l/L) ~ h^rh{b 1/v t,b d - Xb h,b/L) (2.20) 



is 



Following the same method, it is possible to derive the scaling forms of thermodynamical 
functions and write all critical exponents in terms of the scaling dimensions Xb and v as: 

(3 — vxb , 5 = 1 , a = 2 — dv , 7 = v(d — 2xj/) , r\ = 2xb (2-21) 

x b 

When the system is limited in space through a surface, besides the bulk term fb in Eq |2.18| 
new local contributions (surface, corner,...) appear to the free energy density, with singular parts 
behaving as above for the bulk. For example, the contribution of a surface with dimension d—1 
transforms as [39]: 

f s (t,h s ,l/L)~b-( d - 1 *>f s (b 1 /»t,b d - 1 - x °h s ,b/L) (2.22) 

where a surface magnetic field h s has been included and x s denotes the scaling dimension of 
the surface magnetization. Following the previous method it is possible to recognize relations 
between surface critical exponents also. 

The consequence of homogeneous behavior of critical quantities is that they have the same 
exponents below and above the transition point. Many exact equalities can be identified between 
these quantities, since we have relations (Eq 2.211 between them which can be all defined by 
the same two independent parameter. Some of these, the so-called scaling laws, are collected 
in Table EH 



a + 2/3 + 7 = 2 Rushbooke's identity 

7 = (3(8 — 1) Widom's identity 

7 = v(2 — r/) Fisher's identity 

a = 2 — vd Josephson's identity 



Table 2.1: Scaling laws 



These equalities can be examined with three independent exponents and they are widely 
supported by experimental works. Here the Josephson's identity used to call the hyperscaling 
relation since it includes the space dimension, but it is relevant only below an upper critical 
dimension d u , defined in Mean Field Theory. Upper that marginal dimension d u , mean field 
theories provide exact values of the critical exponents and determine the scaling functions. It 
has been shown that the failure of usual scaling functions within the mean field regime is related 
to variables (scaling fields) which become dangerously irrelevant for d > d u . These variables 
affect the scaling behaviour and breakdown that hyperscaling relations which connect critical 
exponents to the spatial dimension d. 



11 



GENERAL OVERVIEW 



2.2.4 Finite size scaling 

Theoretical considerations are true if we always assume that the system size is infinite. How- 
ever in real experiments and Monte Carlo simulations the size of the examined system is nec- 
essary finite which modify the critical quantities of the system. To extract values of critical 
exponents and critical temperature by observing the variation of measured quantities with the 
system size L is the subject of finite-size scaling methods. 

If we measure on a finite system at the vicinity of the critical point of a continuous phase 
transition, the correlation length £ cuts off as it approaches the system size £ > L. As long 
as £ -C L the system behaves the same as for the infinite size limit and the thermodynamical 
functions have homogeneous form as we have seen in Sec |2.2.3| Then the free energy can be 
written at the form of Eq |2.18| 

f(t, h, L) ~ L- {2 - a)/l, ]{L 1/u t, L d - Xb h, 1) (2.23) 

where we used the substitution b = L using the same fashion like in scaling hypothesis. Note 
that here v and a assume their infinite lattice values. The choice of the scaling variable L x l v t 
was motivated by observation that the correlation length diverges as £ ~ t~ v at the critical 
point but limited by the system size L. So L/£ scales as L/£ ~ Lt v ~ L x l v t which is true in the 
asymptotic regime L/£ 1 [40,41]. Now if we differentiate it with respect to the scaling fields 
h or t, we can get the finite-size scaling form of the thermodynamical functions. For example 
after differentiate it with respect to the magnetic field the magnetization: 

m(t, h, L) ~ lr p l v m{L l l v t, L d -* b h, 1) (2.24) 

Since this scaling form is supposed to be the same for all system sizes, they should fall together 
if we plot them on the same graph [42] . This collapse is expected only with the true (infinite size 
limit) values of critical exponents and T c . This leads us to the crucial idea of finite-size scaling, 
since if we do not know these exact values but we measured the thermodynamical functions 
for different sizes, then vary the exponents and T c , the best collapse of the function curves will 
determine the critical temperature and exponents. 

At the critical point of a second order phase transition an infinite correlated cluster takes 
place in the system which indicates a fractal like structure. The mass of this percolating cluster 
scales with the linear system size as: 

M (L) ~ L df (2.25) 

where df is defined as the fractal dimension of the system, and it is allowed to be a non-integer 
number. The magnetization density for finite systems is m(L) = L~ d M(L) by definition where 
d denotes the euclidean dimension of the system. Thus following from Eq |2.24| the fractal 
dimension is related to the scaling dimension of magnetization as 

d = d f + x b (2.26) 

2.2.5 Confer mal invar iance 

Covariance under conformal transformations is expected to hold at the critical point of sys- 
tems with short range interactions, which possess translational and rotational symmetry and 
are invariant under uniform scaling [34]. A conformal transformation r — ► r'(r) can be seen 
as a generalization of uniform scaling, where the structure of the lattice locally preserved, but 
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the rescaling factor b(r) becomes a smooth function of the position. Geometrically those map- 
pings are conformal invariant where the angle cos(0) = r- ? v /(r 2 r' 2 ) 1 / 2 between r and r / holds 
unchanged under the transformation. 

Conformal transformations compose a group. This conformal group is finite-dimensional for 
systems with dimension higher than two and contains rotations, uniform dilatation, translations 
and inversions. A special conformal transformation, which is a composition of the previous ones 
is: 

¥ v 

^T2 = -2+ a ( 2 - 27 ) 

contains an inversion, a translation and an inversion again. It is especially useful, since a semi- 



infinite plane with a flat surface which contains the origin, is invariant under Eq 2.27 if a is 
parallel with the surface. The covariance under such an infinitesimal transformation determines 
the form of critical two-point functions. 

The method of conformal invariance is especially powerful in two dimensions where the con- 
formal group, being isomorphic with the group of complex analytic functions, becomes infinite- 
dimensional and strongly restricts the possible values of critical exponents for a broad class of 
systems. Then it is natural to use complex coordinates z — x + iy (and z = x — iy) and use 
complex mapping w{z) to go from one geometry to another. If some critical correlation is deter- 
mined in the first geometry it can be transformed into the second geometry. It is known [10,43] 
that under conformal mapping z — > w(z) in two dimension, the correlation functions of given 
operators (j)i(zi,Zi) transforms as: 

(<Mzi,2i)<M*2,22)...) = [nK(^)i A v(^)i Si " 

i 

X ((f>i(w(Zi),w(zi))(f)2(w(Z2),w(z2))...) (2.28) 

where the local dilatation factor is then b(zi) = \dw(zi)/dzi\~ 1 and Xi = + is the scaling 
dimension of the operator (j)i(zi,Zi). 

A generally used conformal mapping in two dimensions is a logarithmic transformation 

w(z) = u + iv = ^lmz (2.29) 

which maps an infinite z plane onto a periodic strip of (u, v) 6 (—00, 00) x [0; L] with L width 
and infinite length. The two-point correlation function in the new cylindrical system can be 
deduced using the transformation in Eq 2.28 



((j>(u u «i U(«2, v 2 )) = {^/L) 2x * (2 3Q) 

m m 11 [2cosh(f ( Ul -n 2 )) -2co^(v x - v 2 ))] x * 1 ' 

which for large distance |iti — U2I 3> L in longitudinal directions is reduced to a decreasing 
exponential form: 

Wui,»iMu2,«2=«i)) ~ (^f) (2.31) 
|ui-« 2 |>i \ L J 

Consequently the correlation length ^ is related to the L width of the strip as [44]: 

e = 7^- (2-32) 

ZlTXtf, 
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Another logarithmic transformation is used to map a half-plane (v > 0) onto a strip with 
free boundaries. This conformed transformation is: 



w = -kiz (2.33) 

7T 

which is capable to study surface correlations. 

2.2.6 Critical dynamics 

As far as here we discussed only the static aspects of critical phenomenas, where we left 
out of consideration the time evolution of the system. However the dynamical behaviour of 
a ferromagnetic system becomes critical also at the vicinity of a continuous phase transition 
point where the £j_ spatial and ^ time correlation lengths become infinite. The characteristic 
of such phenomena depends on the initial state whereby the system was started [45-48] . If we 
initiate our infinite system at a temperature T <T C and heat it up to T = T c then the system 
pass through a equilibrium relaxation. The magnetization which is not zero initially behaves 



under a scaling transformation r' = r/b (see in Section 2.2.3) as: 

m(t) ~ b-' x m{t/b z ) which goes as m(t) ~ t~ p/vz (2.34) 

if we set the time t = b z . Here (3 and v are the static critical exponents defined in |2.2.2| and z 
is a new dynamical exponent. 

Another rules control the system during non- equilibrium relaxations. Here we start the system 
from a random initial state (T — oo limit) where the correlation length is £j_ <C L, and quench 
it to T = T c . Then the magnetization grows as: 

m(t) ~ t e (2.35) 

for a macroscopic time before the actually expected decay towards equilibrium takes over [45]. 
The 9 exponent cannot be expressed in terms of scaling relations of static exponents. It is 
due to the behaviour of the magnetization in this short-time limit which is controlled by a 
different scaling dimension xq than in equilibrium where the scaling dimension is x m = (3/v 



(see Eq 2.21 1. This new scaling dimension can be expressed of the form xq — 9z + 13/ v. After 



the magnetization is reached its maximum, then it starts to decrease toward its equilibrium 



value m(t — ► oo) = and following the same behaviour as it was defined in Eq 2.34 

In non-equilibrium phase transitions the system is not invariant under time translation and 
the time correlation lengths behaves as: 

t\\ ~ M"" 11 (2-36) 
where v»{= t) is the time correlation exponent also called relaxation time. In the scaling 



regime the relation ^ ~ £ 2 obtains between the spatial (for definition see Eq 2.14) and the time 



correlation lengths which define the critical dynamical exponent as z = v\\/v, where v is the 



spatial critical exponent defined in Eq 2.14 



Eventually for a finite system in the long-time regime the decay of the magnetization becomes 
exponential 

m(t) - e~* /T ' (2.37) 

where t' is the finite size relaxation time. This is scaling with the system size as t' ~ L z and 
cause a critical slowdown for larger sizes. However if we use sufficiently large lattice and short 



time a good estimate of z can be determined from Eq 2.34 [40] 
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Another way to characterize dynamical features of a system is to measure the two-times 
autocorrelation function which is defined as: 

A(a,t) = (*i(8)<Ti(t)) -(<x(t)) 2 (2.38) 

where the second term on the right hand side is the square magnetization which is zero at the 
critical point. Here s and t denotes two time moments and (Ji(t) is the value of the ith spin 
at time t. From the two moments the smaller s is called waiting time, used to be constant 
during the measure while t is the measuring time which evaluate the system. To measure 
the autocorrelation function we fix the waiting time s and measure the time-correlation as a 
function of t when t > s. At the critical point the autocorrelation is a homogeneous function 
and scales as [49]: 

A(s, t) ~ b- 20 ^A(s/b z ,t/b z ) (2.39) 

In equilibrium relaxations by definition this function depends only on t — s. Thus if s — > and 
t —>■ oo, and we use the substitution t = b z , this scaling function can be rewritten as: 

A eq (s,t)~(t-s)- 2f} /» z (2.40) 

In non- equilibrium case when the system quenched below its critical temperature, the char- 
acteristic domain size grows as 

£(t) ~ i 1/z (2.41) 
and the autocorrelation function can be decomposed into two parts [47,50,51]: 

A(s,t)=A st (t-s)+A ag (t/s) (2.42) 

where the first short-time component A st (t— s) is induced by reversible processes inside domains 
and vanishes out rapidly. Then the second aging term A ag (t/s) becomes relevant which is driven 
by the irreversible motions and annihilation of domain walls. At the critical point we neglect 
the first term so the autocorrelation function becomes a homogeneous function of t/s. Then it 
can be written in a scaling form following from Eq |2.39| if we set s = b z as: 

A ag (s,t)~ s -W-l(f/ s ) (2.43) 

If the system size is finite, after a long time process the autocorrelation function decays as an 
exponential function 

A(s,t) ~ e - [t - s)/T (2.44) 
presents the same fashion of finite size effect as we saw for the magnetization above in Eq |2.37| 

2.3 The Potts model 

2.3.1 The general Potts model 

The Potts model is a generalization of the Ising model with arbitrary number of spin state 
q. It was introduced by Renfrey B. Potts in his PhD thesis [52] suggested by Cyril Domb and 
defined in general as follows. Take a graph G — (V, E) where at each vertex a spin variable Oi is 
located, taking one state from Oi = 0...q— 1 with equal probability. Consider nearest neighbour 
interactions only and include external field in the system, the Hamiltonian of the Potts model 
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forms into: 

n = - JijSfa, <?]) - Yl h ^ ( 2 - 45 ) 

(id) ' 

where the first sum runs over all nearest neighbours Jij denotes the strength of exchange 

interaction between neighbouring spins <Ji and <jj and hi is the external field influence on the 
spin located at the zth vertex. If > the system is ferromagnetic however if < 
then antiferromagnetic rules govern the interactions. If J = then the system behaves as a 
paramagnet. The Kronecker delta functions is 5(cri, (Xj) = 1 if <jj = Uj otherwise it is <5(<7i, (Xj) — 
0. The partition function of the Potts model can be written as 

Z(q,J,h > f3)=J2e~ m ' Ti) ( 2 - 4 6) 
M 

where the sum runs over all possible q> v > spin configuration and |V| denotes the number of 
vertices in V . From this partition function Z one can calculate the different thermodynamical 



properties and critical exponents of the system (see Section 2.2.1 and Section 2.2.21. 

To present the high temperature expansion of the partition function at zero external field 
hi = 0, we may use the linearization e aS — 1 + (e Q — 1)8 which is valid only if 8 £ {0, 1}. Now 
introducing Vij = e^ Jij — 1 then the partition function can be evaluated as 

Z(q,J,(3) =5>-^<m> =J2U e-W<*""> = J2 II ( 2 - 4 7) 

M M (iJ) W} (id) 

Then we rearrange the sum and give it in terms of any (possibly not connected) subgraph. The 
number of possible subgraphs is 2' £ ', where \E\ is the number of edge in G. The partition 
function can be then rewritten as 

Z(q,J ) f3)= ]T q c{G,) J] v e (2.48) 

G'CG eGG' 

where c(G") denotes the number of connected components of G'. Within a connected component 
all spins possess the same state, distributed independently from the possible q state. The 
product runs over all edges included in the subgraph G' with the convention that if G' is 
completely isolated i.e. there is no edge in the subgraph, the sum is equal to one. In the high 
temperature limit (/3 <C 1), only the subgraphs with few edges contribute to the sum, so a 
possible approximation is to take only these G' subgraphs with small number of edges. This 
approximation is a high temperature expansion since it is getting better as the temperature is 



increasing. Note that Eq 2.48 gives an extension for Potts model, when the previous defined 
Z (in Eq 2.461 is not valid, since we can introduce it with non-integer values of q relating this 
model to other problems. 

For ferromagnetic q = 2 Potts model on two dimensional square lattice in absence of external 
field, the critical temperature is known from the exact solution of Onsager [29], which gives the 
partition function for arbitrary T as well. If q > 3 the critical temperature is exactly determined, 
however the partition function is given only at T c . When q — 3 the critical point is only known 
exactly in isotropic case. In anisotropic case T c is predicted by numerical calculations only, 
however it is strongly believed to be true [53] . The phase transition of the Potts model in two 
dimensions depends on the value of q. An exact solution exists to establish the phase transition 
first order if q > 4 and higher order if q < 4 [54]. When q = 2 the Mean Field solution of 
the model is valid only above the upper critical dimension d c = 4. In the presence of external 
field or in higher dimensions, the critical behaviour of the Potts model is known by numerical 
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predictions and scries expansion calculations only, and no exact result exists. 

A few more specifications of the Potts model exist, transform the general model to another 
fundamental problems such like the six- vertex ice rule model, the Potts lattice gas [55, 56] or 
the colouring problem of antifcrromagnctic Potts model. Some of them will be introduced later 
here, however all of them demonstrate the expedience of the original model, and explain the 
prominent attention of scientists during the last few decades. In the following we are going to 
outline the Random-Cluster model which is capable to describe the partition function of the 
g-state Potts model. Some special cases of Potts model will be introduced which we will use 
later in the thesis. 

2.3.2 Random-cluster measure 

In the 1970s Fortuin and Kastelcyn realized, that the series-parallel laws of Kirchoff [57], 
which was defined in 1847 on electrical networks, were adaptable for Potts model with different 
values of q. This observation led them to define the Random Cluster model (RC model) 
[58-61] and obtain a high temperature expansion of Potts model. This model is capable to 
find macroscopic properties in terms of local structures and define the partition function of the 
g-state Potts model using only combinatorial considerations. Here we are going to discuss the 
essence of their method. 

Lets take a finite graph G(V, E) where V denotes the set of vertices and E the set of edges 
of the graph. The configuration space of RC model is the set of all subset of the edge-set E, 
present like f2 = {0, 1} E , where an edge e G E is called open if lo G ft and uj(e) — 1 otherwise 
it is closed when ui(e) — 0. For a w £ O, let rj(u>) = {e 6 E : uj(e) = 1} denote the set of open 
edges and c(u>) the number of connected components of the subgraph G' = (V, including 
the separated vertices. 

The model has two parameters, the probability density of open edges p G {0,1} and the 
cluster weight factor q G {0,oo}, which gives the number of cluster types. Now a 4> Piq (uj) 
measure on the configuration space £1 is given by: 

^,»=^{nf w(e) ( i -p) i " tj(e) U cM ( 2 - 49 ) 

RC leeE ) 

where the partition function is defined as: 

z ^ = E { II p^a-p) 1 -^ ) <z cM (2.50) 

When q G Z is an integer, and q > 2 the previous defined partition function Zcl corresponds 
to the Potts partition function defined in Eq |2.48| since it can be written as: 

^c = (i-^E{n(r^) w(e) U cM (2-5D 

where \E\ denotes the number of the edges in G = (V, E). Substituting v e = p/(l — p), and 
choosing p = 1 — e _/3 we find that the partition function of RC model and Potts model are 
related: 

Zrc = e-^Z Potts (2.52) 

We discuss this relation between the random cluster model and Potts model in a different 
way the in Appenddix [A"} 
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2.3.3 q = 1 - Percolation 

The percolation model as a stochastic mathematical theory was firstly introduced by Broad- 
bent and Hammersley in 1957 [62] for modeling fluid or gas flow through a porous medium. 
This model turned to be equivalent to the g-state Potts model when q = 1 and gives one of the 
simplest example of phase-transition and critical phenomena. 

To define the model we proceed from a graph G — (E, V) and declare each edge e € E 
independently to be open with a probability p or set it closed otherwise with probability (1 — p). 
The open edges forms connected clusters of neighbouring vertices in the graph. This is the 
definition of the Bond Percolation model (BP). It is equivalent with a probability measure 
on a configuration set f2 p = Yl eeE {0, 1}, where each configuration represented by a subgraph 
G' = (£", F)CG whose edge set E' contains precisely the open edges. The probability p plays 
the control parameter role in the system. For p above some percolation threshold p c an infinite 
cluster exists besides the many finite clusters. 




Figure 2.2: a: Phase diagram of percolation model. Here the percolation probability plays the order 
parameter role and the control parameter is p. b: Graphical representation of an animal with size 6 
and perimeter 10. 



The order parameter like percolation probability 0(p) is defined as the probability that a 
randomly chosen site of a graph belongs to an infinite percolating cluster in the thermody- 
namical limit. This quantity corresponds to magnetization of spin systems and &(p) = at 
the sub-critical phase p < p c , and becomes 0(p) > above the critical point p > p c when 
the system is at the supercritical phase. It is straightforward that 0(p) = 1 when p = 1 and 



all edges are open in the graph G (see Fig 2.2 a). For finite lattice the percolation cluster can 



evolve below p c , thus the system presents the exact behavior only at the thermodynamical limit 
when N — > oo. 

To define further macroscopic quantities we need to calculate c n , the number of clusters of a 
given size n per a site. It can be given by: 

c n {p)^Y.9nsP n {l~P) s (2.53) 

s 

where g ns denotes the number of finite cluster configurations (animals) with size n and perimeter 
s. Here the perimeter is defined as the number of nearest neighbours of the sites of a finite 
cluster excluded from the cluster (see Fig|2.2|b). The average of (c n (p)) corresponds to the free 
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energy of the system. Then the average cluster size can be written as 



(2.54) 



which becomes S(p) = ^ n c n n 2 when p > p c , since the denominator turns to be finite. S is 
behaving as the susceptibility of the system and divergent around the critical point. 

All these quantities have critical behaviors around p c , and are described by a set of critical 
exponents which accomplish the scaling laws. The critical point p c (G) and exponents depend 
on the geometry of graph G and lead the systems to different universality classes. 



1", J i.'.'i! i-iiV'V^"^ 





P<Pc 



P=R 



P>Pc 



Figure 2.3: Illustration of different phases of percolation. On the left plaquette the system is below the 
critical probability p < p c where only finite clusters (green) occurs. At the critical point p = p c (middle 
plaquette) an infinite cluster (red) takes place all over the lattice. Above the critical probability p > p c 
(left plaquette) the infinite cluster contains most of sites and only finite number of finite clusters are 
present. 



Another analogous model exists, called the site percolation (SP), where sites are chosen to 
be open with probability p and to be closed otherwise. Here the neighbouring open sites shape 
clusters and follow the same behaviour presented above for BP. The critical points of the two 
models are relating as pf P (G) < j?f p and depends on the choice of the graph. It is equal for 
trees, and not equal for finite dimensional lattices with d > 2. For example for two dimensional 
square lattice pf p = 1/2 since the lattice is self dual, while pf p ~ 0.59746(5) follows from 
numerical results. Even if the critical points of the two percolation problem could be different, 
the critical behavior of the two models can be characterized with the same critical exponents. 

Since the Bond Percolation is equivalent to the Random Cluster Model with q = 1 it gives 
the possibility to consider bond percolation as a special case of the (/-state Potts model with 
only one possible state. This enables us to study a percolation problem in the terminology of 
spin systems. Many other modification of the percolation problem exist, with different critical 
behaviors e.g. directed percolation (where the edges are directed in the graph), and was specified 
in many part of research giving expedient models from epidemic spreading to microelectronics. 



2.3.4 q = 2 - Ising model 

As we have seen before, the Ising model was the first capable model to describe analytically 
a phase transition. Since the Potts model is a generalization of this model, we can define the 
Ising model as a specific Potts system with q = 2 number of states. In general we are taking 



19 



GENERAL OVERVIEW 



account only nearest neighbours interactions which gives the Hamiltonian: 

Hlsing = ^ <?i&j -h^^Ui (2.55) 

(id) i 

where 0$ — ±1 and the first summation runs over all first neighbouring spins of the system. 
The critical behaviour of the Ising model in absence of external field have been shortly discussed 
in Section l2~l~2l 

Beyond the Potts model, a few other generalizations of the Ising model do exist. Since in the 
Ising model the spins are restricted to align parallel to the magnetic field, this model is capable 
to describe strongly anisotropic systems only. However if the spins <7j are n dimensional normal 
vectors, then if n = 1 we get back the original Ising problem, but when n > 1 we get more 
realistic models with 0(n) continuous rotational symmetries. If n = 2 the spins can align to 
any direction continuously around a unit circle and the system energy can be written like: 

(id) 

This is the classical XY model. Then if we choose n = 3 we arrive to the classical Heisenberg 
model defined [63-65] with the Hamiltonian: 

n H = J X>?<7? + + <°i) - h E < ( 2 - 57 ) 

(id) ' 

Finally if n — *■ oo the system is transformed to the so-called Spherical model [66]. The classical 
Heisenberg and XY model are more capable to describe the behaviour of ferromagnets, however 
it is possible to define the related quantum models where the spin operators are determined by 
Pauli matrices. Even quantum models have greater difficulty in analytic and numeric treatments 
[31] in many cases they give a better approximation then the classical description. 

Following from the Mermin-Wagner-Hohenberg theorem [67, 68] in two dimensional systems 
if n > 2 the continuous symmetries cannot be broken spontaneously at any finite temperatures 
T =/= 0. There is no magnetic order at T > since the thermal fluctuations destroy any long 
range order even at low temperatures. It is not true for the Ising model which has discrete 
symmetry, and indicate spontaneous symmetry breaking below the critical point T c > 0. 

For the XY model another type of phase transition occurs which does not affect any spon- 
taneously broken symmetry. At high temperature the system is disordered and the correlation 
length is falling exponentially, however another phase exists at low temperature when the cor- 
relation length is following a power law and a quasi-long range order appears in the system. 
Between the two phases at a critical temperature, a Kosterlitz-Thouless phase transition of 
infinite order occurs. 

Other possible generalization of the Ising model if we are not taking into account only the first- 
neighbour couplings during the calculation of the energy, but define interactions between second 
or further neighbours as well. In the limit when every spin is interacting with all spins of the 
system we arrive to the mean field presentation of the model. This can be interpreted in different 
ways, like studying the Ising model on a complete graph (where every site connected to every 
site) or defining an average molecular field which includes the influence of all spins but neglect 
any fluctuation. This two definition is proved to be equivalent and gives the Hamiltonian: 

umf = - jf^j E E - h H ^ ( 2 - 58 ) 

i i^tj i 
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where z denotes the coordination number of the graph [69]. Following this Hamiltonian the 
magnetization per site can be deduced analytically in a self-consistent form [70]: 

m = tanh [/3(zJm + h)] (2.59) 

which is capable to calculate exactly the free energy and the critical properties of the system. 
The mean field problem can be solved analytically on Bethe lattice and it gives the same 
critical exponents as the former solution. The mean field approximation is relevant only above 
the upper critical dimension d c = 4 and far from the critical point since at the criticality the 
fluctuations become important, so the calculated critical exponents usually deviate from the 
measured ones. 



2.3.5 q = oo - Potts model with infinite number of states 

In two dimensions for the pure Potts model (when = J) an exact result of Baxter [54] 
ensures a first order phase transition when q > 4. However in the large g-limit the pure Potts 
model is solvable in any dimension since thermal fluctuations are reduced. As we have seen 
before, in absence of an external field in general the Hamiltonian of the Potts model can be 
defined as: 

H = - E ■M(ffiO'j) (2-60) 

(id) 

where <7j = 0...q — 1 and the sum runs over all edges. Then proceeding from the definition in 
Eq |2.46| the partition function evolves as: 

z = e e ~ ma) = e i c{g ' ] n ( e/3jc - !) ( 2 - 61 ) 

{cr} G'CG eeG' 



where we applied the Fortuin-Kasteleyn high temperature development (see Section 2.3.2 1. Now 
we introduce a reduced temperature T' — Ting or its inverse as (3' = /3/lnq. This reduction is 
needed to keep the critical temperature finite, since if q — > oo then T c — > however T c Xnq — > 2 
[71-74]. If we apply now the substitution e l3Jc = e ln9/3 J " = q@ Je then the partition function 
arises of the form: 

z= e ? c(G,) n (f ,j ° - 1) ( 2 - 62 ) 

G'CG eeG' 



which is equivalent to Eq 2.48 with the parameterization v e — q@ Je — 1. Since all J e > we can 
rearrange the product on the right hand side and write the partition function until the second 
term as: 



G'CG 

q «G')+P'i: e Je _ q c( G 'W^ m , n J ' + ... (2.63) 

G'CG 



Here the first term is always the largest one for a given subgraph, since it contains all the 
ferromagnetic edges eeG", then the second term is the second largest, because we exclude 
only the weakest edge e m in from the summation, etc. Following this method we are able to 
write all the terms in order to choose the maximum from the set of the first terms to find the 
subgraph G which contributes to the dominant term of the partition function. Then the second 
largest term would be the maximum of the remaining first terms of G" ^ G' and the second 
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term of the previous chosen G'. 

Z = max G ,c G q^+P'^a, Je + maXG „ #G/ (g c(G")+/3'£ ee0 „ J % q «G')+0' E e ^ min J.) + ... 

(2.64) 

The first term in the right hand side of Eq |2.64| has the largest exponent of q, so when q goes 
to infinity the partition function can be rewritten as 

Z ~ 1 HG ' ] where 0(G") = c(G') + j? ^ J e (2.65) 

G'CG eGG' 

which is dominated by the largest term <fi* = maxg^G') only which defines an optimal set of 
edges G* which degeneracy is likely to be one. Thus the study of the large g-state model is 
reduced to an optimization problems which solution depends on the temperature and the given 



realization. The free energy of the system, following from the definition given in Eq 2.3 can be 
calculated as 

Z = e-^ = q-P* = q*' (2.66) 

thus the free energy per site is given by — /?'/ = (ft* /N where N denotes the number of sites of 
the system. 

In the pure ferromagnetic Potts model when Jij — J the structure of the optimal set in the 
different thermodynamical phases are trivial which follows from the next proposition. 

Definition 2.3.1. A type I graph is a graph for which exists w c — Jf3 c such that the optimal 
set G* with edges all having the same weight w = Jj3 is 



G* = 



if w < w c 
E if w > w c 



Definition 2.3.2. Let G = (V, E) be a graph and II the set of permutations of E (automorphy 
group) such that V £ E, (7r(i), 7r(j)) £ E, where n e II. 

Proposition 2.3.3. If for any e G E and f e E there exists ir £ H such that f = 7r(e), then 
G is a type I graph. 

Proof. If an edge e £ E belongs to an optimal set, then every edge belongs to an optimal set 
since there exists / = 7r(e) for any /, e £ E. The union of optimal sets forms an optimal set 
as well. Consequently if one edge is belonging to an optimal set, all edges e £ E belong to the 
same optimal set, so E is an optimal set. On the contrary, if even one edge is not belonging 
to any optimal set, then either of the edges belong to any optimal set, so the optimal set is 
and we proved that G is a type I graph. We remark that all the regular lattices of statistical 
mechanics are type I graph. □ 

The consequent of the proposition in Prop |2~3T3l is that in the pure ferromagnetic case the 
optimal set is either fully connected or empty. A phase transition of first order takes place 
between the low temperature and the high temperature phase with non-analytical behaviour of 
the free energy at the critical temperature when the two phases coexist. This critical tempera- 
ture T c can be calculated easily since below the phase transition point T < T c the optimal set 
contains all the edges e £ E and the free energy is —(3'fN = 1 + N/3'Jd, while above T c the 
optimal set is an empty diagram so the free energy is —/3'fN — N. Consequently at the phase 
coexistence point 1 + Nf3'Jd — N so the critical temperature is T c = Jd/(1 — 1/N). 

Thus all the information about the Potts model in the large q limit is contained in the optimal 
set G*, since the partition function, the free energy and the other thermal properties can be 
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Figure 2.4: Free energy of the pure q- 
state Potts model to the inverse tem- 
perature. Below Tc (above 1/T C ) the 
optimal set contains all the edges and 
f(T) is linear. Above T c (below 1/T C ) 
the optimal set is empty and f(T) is a 
constant function. 



deduced from that. Moreover the magnetization and correlation function can be obtained from 
the geometrical structure of G* what will be discussed in details later for the disordered case 
when the dominant graph has a nontrivial structure. 



2.4 Disordered models 

Disorder in physical systems can be characterized by the deviation from the completely 
ordered phase [11]. For example in ferromagnets at T — and h = the system is completely 
ordered since the energy minima determines all the coupling of magnetic moments and the 
system is in its ground state. By increasing the temperature the order is weakening as certain 
magnetic moments deviate from their ground states and disorder arises in the system. The 
origin of such spontaneous disorder is twofold: it can rise from thermal fluctuations or quantum 
fluctuations. However it is possible to introduce non-spontaneous disorder which affects the 
critical behavior of the system. This additional disorder used to be introduced in two ways. 
If the system is conducted by random variables which do not evolve with time, the system is 
called to be quenched disordered. It is opposite to annealed disorder, where random variables 
are allowed to evolve. In the following section we discuss the effect of quenched randomness on 
phase transitions and define some related models. 



2.4.1 Effects of disorder 

To understand the effects of disorder in statistical systems we need to use the terminology 
of renormalization group theory [5-7, 75] . The idea of renormalization is to change the scale 
of the system, which decreases its degree of freedom and transform its parameter into a point, 



where the system becomes scale invariant as we have discussed in Section 2.2.3 In real space 
renormalization it can be described as an energy scale transformation, where the Hamiltonian 
is replaced by another Hamiltonian with the same structure, but with different parameters and 
reduced degree of freedom. This parameter change is equivalent to moving at the parameter 
phase during the renormalization iteration. The critical point corresponds to a fixed point at 
parameter phase, where the correlation length becomes infinite and the system is scale invariant. 



Relevance-irrelevance criterion 

For homogeneous systems with continuous phase transition, perturbation can change the 
system's criticality. Using renormalization methods we can see how a suitably large disorder 
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can move the fixed point at the parameter phase, and change the critical exponents of the pure 
system, transform the model into a new universality class. The stability of the fixed point 
against disorder were firstly studied in diluted models (see later) by Harris, but his results can 
be generalized for any kind of bond disorder. 

The Harris-criterion predicts the perturbation relevant if at the pure model 

dis/2 - 1 > (2.67) 

where d is the dimension of the system and v is the correlation exponent. In other words it 



is valid if the specific heat exponent is positive a > (see Eq 2.141. In that case the system 
moves towards the parameter phase into a new fixed point with new exponents, different from 
the original pure system. When a < the disorder is irrelevant and the system keeps the original 
pure exponents during the renormalization. At the marginal case a = further considerations 
are needed. However the above defined criterion is valid only at weak disorder, close to the 
pure system fixed point, since sufficiently strong disorder can transform the system into a new 
fixed point even though it was resistance against weak randomness. 

Another consideration exists by Imri and Ma [76] about the effect of random field on systems 
with continuous phase transitions. To present their idea we proceed from the Ising model at 
low temperature and suppose that there are two domains of spins in the system with linear 
size L which are orientating to the opposite direction. Now the energy loss by the surface 
between the two domains is E sur f ~ 2JL . However, applying random field, the system 
earns E rf ~ hL 11 ' 2 energy by the spin fluctuation inside the domains. Now if we compare the 
two energies: 

Es ^l ~ Li*/*- 1 (2.68) 
E r f h 

This means that if L — > oo then the ferromagnetic phase disappears at any finite temperature 
if the dimension is smaller than two. 

When the pure system has first order phase transition, the effect of disorder is more compli- 
cated. We do not have any kind of criterion of relevance or perturbation expansion to describe 
the behavior around the discontinuous transition point. However it is known rigorously [77] 
that in two dimensions a first order phase transition softens into a continuous one if any amount 
of disorder is applied. Such behaviour is true in three dimensions as well, but there exists a 
crossover region where for weak disorder the transition keeps first order and presents continuous 
behaviour only for sufficiently strong disorder. 

If the system stays inhomogeneous on macroscopic and microscopic scale during the coarse- 
graining renormalization iteration and relative magnitude of inhomogeneities (i.e. ratios of 
parameters in the Hamiltonian) do not remain finite in the long-wavelength limit then the 
system is controlled by an infinite randomness fixed point. In such systems the distributions of 
logarithmic magnitudes of the terms in the Hamiltonian become broaden as the energy scale 
tends to zero. This means that in finite quenched system the thermal quantities become sample- 
dependent. Consequently if we are interested in average quantities in a finite system with size 
TV, it is necessary to perform an additional quenched disordered average over the disordered 
configurations. The fluctuations over samples of an arbitrary thermodynamical quantity X 
then can be described by the following relative variance: 

V N (X) = [X2]a ^ ? [X]L (2.69) 

where [...] av denotes the sample-to-sample average of quantity X. If V~n(X) tends to zero as the 
system size N — > oo then the quantity X is self-averaging and a sufficiently large system is a 
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good representation of the whole ensemble. However if Vjy(X) tends to a constant as N — > oo, 
and even the critical point is known exactly, statistics cannot be improved by going over larger 
size. In this case X is called to be non-self-averaging and in order to characterize X, its whole 
distribution is needed. 

2.4.2 Models with disorder 
Diluted magnets 

For classical systems beyond thermal fluctuations another type of disorder can be introduced. 
One of the simplest realization of such systems are the diluted magnets. In this case the 
Hamilton operator of the Ising model can be written as 

Hdm = ~} j Jij(Vi (J i)('ih^]) (2.70) 

(id) 

which is capable to describe the two main types of dilution. For site diluted models the ex- 
change energy is constant = J and for each site we choose 77^ = with probability p and 
rji = 1 otherwise with probability 1 — p. This model can represent for example a binary al- 
loy where magnetic and non-magnetic particles occupy the lattice sites randomly with a given 
concentration p. However we can introduce another type of dilution (called bond dilution) 
where each site is occupied (77^ = 1) but the exchange energy is Jij = with probability p and 
Jij = J > with probability (1 — p) independently for each couplings. Both models have two 




Figure 2.5: Phase diagram of diluted 
magnets. The ferromagnetic (FM) and 
paramagnetic (PM) phase are sepa- 



p c \ p rated by a critical line. 

relevant parameters, the temperature T and the p concentration of non-magnetic components. 
At T — 0, decreasing p from one towards zero at a given critical p c , an infinite cluster of con- 
nected sites arises all over the system and we get back the problem of percolation that we have 
already discussed before in Section |2.3.3| At the phase diagram if we cross the separatrix, a 
continuous phase transition occurs belonging to different universality classes. When T = it 
is the universality class of percolation, while at p = it is belonging to the university class of 
pure ferromagnetic systems. If p is between < p < p c then the exponents are constant. If the 
dilution is irrelevant the critical exponents are the same like in the pure case, however if the 
disorder is relevant then a new fixed point determines the phase transition in the hole region 
< p < p c with new critical exponents. 
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Random bond models 

Another type of bond dilution can be denned on random spin systems. Here the couplings 
Ji,j > ar e independently distributed random variables with positive mean and A deviation, 
which define the third relevant parameter of such random systems. This kind of dilution can 
change the order of phase transition, typically softening it from first order to continuous as we 
increasing A away from zero [74,78-80]. 

The ferromagnetic random bond Potts model in the limit q = oo corresponds to this case 
where the couplings Jij are independently distributed positive random variables sampled from 
a probability distribution P(Jy). The Hamiltonian of the model is defined in Eq 2.60 Since 
the system is ferromagnetic (Jy > 0), the ground state must be one of the q states where all 
the spin have the same value. On a two dimensional square lattice if < fiJij < 1 and the 
distribution P(J + A) = P(J — A) is symmetric, the critical point can be derived from self-dual 
relations [81]: 

T c = )- = 2J (2.71) 

Pc 

where J > denotes the mean of the coupling values. This critical point separates the ferro- 
magnetic and paramagnetic phases. For the A = pure case, Eq |2 . 7 1 1 equivalent of the form we 
have seen in Section |2 . 3 . 5 1 when the size N — ► oo and the phase transition is of first order. As a 
quenched disorder is switched on, the nature of the phase transition changes. This question was 
studied by Cardy anf Jacobsen [?] , who construct an interface Hamiltonian which was mapped 
onto that of the random field Ising model. They found that for d = 2 for any small amount 
of disorder destroys the phase coexistence at T c and the phase transition softens to second 
order [73,77]. In higher dimensions d > 2 for weak disorder the correlation length stays finite 
at the critical point and a phase coexistence persists define the phase transition first order. 
However for strong enough disorder the correlation becomes divergent at a tricritical point and 
the phase transition is of second order, the phase transition line is broken and an additional 
phase arises [74]. 

Some kind of bond dilution is capable to change the critical behaviour not only at the critical 
point, but at the vicinity of the criticality too. If we set the couplings in the ferromagnetic 
Hamiltonian to J\ with probability p and J2 otherwise ( J% > J 2 > 0) then some quantities 
present singular behavior in an extended phase around the critical point [82]. This phase is 
located between the critical temperature for the onset of magnetic long-range order and the 
critical temperature of the pure model [83]. This so-called Griffiths phase [84] is caused by rare 
local domains which are in the contrary phase that the whole system itself. 

Random field models 

If we introduce disorder into the field term hi instead of the couplings Jij in the Hamiltonian 
Eq |2.55| we arrive to another important class of disordered systems called random field models 
which were defined first by Imry and Ma [76]. Suppose that the couplings are Jij = J homo- 
geneous and define hi as an independent random variable with a given distribution P(hi) with 
zero mean. In such systems there is competition between the long range order and the random 
ordering field, since the neighbouring spins tend to align parallel while the applied external field 
tries to pin each spin according to the sign of the local field. 

In the random field Ising model (RFIM) the system has two relevant parameters, the tem- 



perature T and the variance of the field distribution V{hi) defined in Eq 2.69 For sufficiently 
small V(hi) and T, the exchange interactions are dominant and the system is in a ferromagnetic 
phase with non- vanishing magnetization. If we increase the field over a critical value V c (ho) 
the system passes through a phase transition, which after each spin earns more if those align in 
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the direction of the local random field, thus any long-range order is destroyed. The mean field 
approximation of the model on complete graphs is always solvable and it determines the order 
of the phase transition depending on the sign of the second derivative of the P(hi) distribution 
respect to the field at ft. = 0. If it is positive then the phase transition is first order while if it 
is negative a phase transition of second order takes place. 

For example if P(hi) is a Gaussian distribution then P"{h — 0) < and the phase transition 
is second order and the system has the same phase diagram than diluted models if we replace 
p with ho. However if P{hj) is bimodal so thus P"(h = 0) > 0, there exists a tricritical point, 
i.e. the phase transition becomes first order for larger critical fields [85]. 

No exact solution exists for any finite dimensional system except in one dimension [86, 87] 
however it is following from numerical treatments that in three dimension the universal be- 
haviour of the RFIM depends on the choice of P(hi) distribution also [88]. The ground state 
of the model is not degenerated if the distribution P{hi) is continuous and it can be weakly 
degenerated only if P(hi) is discrete. To find the ground state of the system we need to solve an 
optimization problem which can be calculated in strongly polynomial time (sec later in Section 
4j[l [89]. 



Spin glasses 

Spin glasses arc disordered materials exhibiting high magnetic frustration. The origin of dis- 
order can arise from disordered structure or the disordered magnetic behaviour of the material. 
In addition the presence of competing interactions and disorder cause a high frustration to the 
system, since it is not able to reach its lowest energy scale. 

The convenient statistical model to study such materials is the Ising spin glass model [90]. 
The Hamiltonian can be deduced from Eq |2.55| if we define hi = h homogeneous and choose 
the exchange couplings J^- = ± Jy with probability p and 1 — p allowing antiferromagnetic 
couplings between neighbouring spins. 




Figure 2.6: Phase diagram of three di- 
mensional Ising spin glass on cubic lat- 
tice. Beyond the ferromagnetic (F) and 
paramagnetic (P) phase an antiferro- 
magnetic (AF) and a spin glass (S) 
phase takes place at the phase diagram. 



The phase diagram of the model is more complex than for diluted ferromagnets, since here 
beyond the ferromagnetic and paramagnetic phase, two other phases occur (see Fig 2.6 1. When 
p is sufficiently large, the antiferromagnetic couplings dominate all over the system, the neigh- 
bouring spins favor to tend antiparallel and an antiferromagnetic phase evolve. 

However between the ferromagnetic and antiferromagnetic phase at low enough temperature 
with intermediate density of antiferromagnetic couplings, a so-called spin glass phase is located. 
If an external field is applied and the system is cooled under a critical temperature, after the field 
is removed, the magnetization of the system has a rapid exponential decay to a certain value 
(remnant magnetization) . Then the magnetization follows a slow non-exponential relaxation to 
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zero. This slow decay is identical to spin glasses and makes large difficulties for experimental 
studies. 

The system has non-degenerated ground state but it has exponentially large number of states 
having approximately the same energy To find the minimal energy state is an optimization 
problem which is solvable in polynomial time in two dimension however it is an NP complete 
problem for higher dimensions. At the energy minima state any long range order is present 
since only local ferromagnetic domains evolve in the system with randomly directed magnetic 
moments. That is why the average magnetization is zero, however its second moment does not 
vanish so it is suitable for order parameter. 
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Chapter 3 



Complex Networks 



3.1 Introduction to Graph Theory 

In Nature, many cases the structure of a complex system can be featured by entities and 
some type of links between them. The subject of graph theory is to mathematically describe 
this kind of structural features and characterize the main properties and laws of the under- 
lying geometries. Historically Leonard Euler was the mathematician, who firstly illustrated a 
structure like this, later called graph, in his demonstration of the Konigsberg bridge problem in 
1736. However his idea was forgotten for more than 100 years later until 1847, when Kirchoff 
used again graphs in the proof of his two laws. Following them in the 20th century the graph 
theory became a powerful model of many parts of science. 

Such a description were found to be relevant to describe structures of complex systems in 
biology, sociology, economy and in many other subjects. Enormous information and techno- 
logical networks grew up like the World Wide Web or the Internet, and parallel many facilities 
appeared to analyze existing networks using new methods and computational tools. Although 
these distinct segment of science were different and they used their own terminologies, many 
of them were found to ruled by the same principles and presented similar structures. We will 
focus on this structures in the following chapter. 

3.1.1 Definitions 

Consider a graph G = (V, E) described by a set of vertices (nodes) V and a set of edges 
(links) E, where the edges link pairs of nodes (p,q) € E (with p,q E V). If the starting node 
p and the ending node q of an edge is ordered, we talk about directed graphs, otherwise it is 
undirected. If p = q we call it loops, which could be directed and undirected as well. Hereafter 
typically we are going to use simple undirected graphs which do not contain any loops and 
multiple edges. 

There are two general ways to represent a graph in mathematics and computer science. If 
the number of vertices N denotes the size of the graph, the N x N adjacency matrix A may 
describe the graph with elements a pq = 1 if a directed edge is presented between vertices p and 
q, otherwise a pq = 0. In weighted graphs the a pq elements of the adjacency matrix are equal 
to the weights of existing edges or being zero. If the graph is undirected, the adjacency matrix 
is symmetrical so it may be converted into an upper triangular matrix. This representation is 
useful if \E\ ~ \V\ 2 so the graph is dense. 

However if \E\ <C \V\ 2 thus the graph is sparse, the so called adjacency list representation 
is usually preferred because it provides a compact way to represent such structures. This 
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representation based on a point array j4dj[p] of every p G V, where each Adj[p] elements own 
an adjacency list of all the nodes q e V which are the neighbors of the given p. If the graph is 
weighted it is easy to include the weight values for each element into the adjacency lists. 

The advantage of the adjacency matrix representation is the direct access of the edges in 
the matrix however this description is fairly robust. The disadvantage of the adjacency list 
description is that we cannot access the edges in one step, but this description does not use 
more memory. 

3.1.2 Graph properties 

To characterize different graphs we need to examine some relevant properties which are 
capable to discriminate the graphs with different structures. Here we introduce the main 
properties which are frequently used in the literature. 

Degree distribution: It is possible to describe a graph with given structural feature geo- 
metrically or we can analyze its statistical properties if its size is sufficiently large. The first 
and most frequently studied statistical parameter is the degree distribution of vertices. The k 
degree of a node is defined as the number of neighbours it has if the graph is undirected. How- 
ever for directed graphs we make difference between in-degree and k ou t out-degree, where 
k in and k out are the numbers of incoming and outgoing edges respectively for a given node. 
The degree distribution shows the fraction of nodes that own a given number of connections 
with an average, defined as the number of connections per site: (k) = 2N e( i ge /N. Here N e dges 
denote the number of edges. 

Average path length: Average path length I is another important graph property, which 
measures the average shortest path length between two connected nodes. Here the shortest path 
length l vq between vertex p and q is defined as the shortest series of edges with unit length, 
called geodesic distance as well. If the graph is directed, £ pq and l qv are probably different. To 
calculate it we need to average the distance over all pair of nodes of a given graph. Between 
separated vertices the average path length is I — oo by definition, and in a fully connected 
graph I = 1, however for a d dimensional lattice with system size N, it scales as I <~ N 1 ^. 

Clustering coefficient: The clustering coefficient C is a local parameter of a graph and 
gives the cliquishness of the neighborhood of a node. Denote the number of first neighbors 
of site q, and n < f] ge the number of edge presented between them. The clustering coefficient 

of vertex q defined as C q — n < fj ge / '(n^ '(n^ — l)/2), where n^\n^ — l)/2 is the maximum 

(p) 

number of possible edges between the n\ neighbours if those would form a complete graph. 
Averaging C q over all vertices q £ V, it yields to the clustering coefficient C of the graph. 
Practically, C gives the probability that if three nodes are connected with two edges then a 
third edge is presented. C was first introduced in sociology [91], but Watts and Strogatz defined 
it in network science in the previous form [92]. 

Connected components: By definition a connected component of an undirected graph 
is a maximally connected subgraph, where each node can be reached by paths along edges. 
Generally a graph is likely to contain more than one connected component with size 1 to N. In 
directed graphs the maximally connected subgraphs or strongly connected components, where 
there are directed paths between each vertex. The largest connected component or also called 
giant component or giant cluster has a primary importance in percolation theory and network 
science. 

Graph spectra: The spectrum of a graph is the set of Aj eigenvalues of its adjacency 
matrix A. It is graph invariant, and it gives a better tool to compare graphs than A itself, 
which depends on the graph labeling. It is also convenient to define the graph spectral density, 
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coming from the random matrix theory [93], as p(A) = n ' wnere \ the it/i biggest 

eigenvalue of A [94] . This density becomes continuous if N — > oo and is related directly to the 
topology of the network. 



3.2 Geometrically ordered graphs 

3.2.1 Regular lattices 

Since the atoms of a crystal are arranged in a fix periodical structure, in solid state physics 
a special type of graph is used to describe such systems which is called lattice. A lattice is 
defined as a symmetry group with translational symmetry in n direction, or in other words, it 
is a space ordered graph with translational invariance. It is arranged by unit cells which fill 
periodically the <i-dimensional space. In theoretical physics many models defined on lattices 
(lattice models) are exactly solvable and also easy to simulate using computational methods. 




Figure 3.1: The triangular lattice (a) and the Kagome lattice (b) are the most studied regular structure 
which can induce geometrical frustration in antiferromagnetic lattice models. 



Another usually required main property of a lattice is the regularity. In graph theory a graph 
is called regular if its each vertex p E V has the same number of neighbors, thus they have the 
same degree k. We called fc-regular graphs those graphs which contain vertices with degree k 
only. 

The geometrical properties of a crystal lattice can induce frustration in condensed matters 
like in antiferromagnetic systems. The simplest regular lattices which cause such frustration 
in two dimension are the triangular lattice and the Kagome lattice (Figure 3.1|, which were 
intensively studied from the early 50s [95] . In these lattices a geometrical constrain arises from 
the structure of the lattice which does not let the system relax to its ground state and induce 
residual entropy at zero temperature. The water ice was the first example which presented such 
behaviour, found in 1936 [96], but later other matters showed similar features. 



3.2.2 Boundary conditions 

Since it is possible to study only finite lattice systems via computer simulations, an important 
question arises about the influence of the lattice boundaries. Beyond the finite size effects, on 
the margin of a finite lattice, all edges which link to the last nodes are hanging and change 
the local free energy. However, by applying special boundary conditions we can eliminate these 
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boundary and corner effects. Here we arc going to outline the main types of the frequently used 
boundary conditions. 

Proceed from a simple two dimensional square lattice with linear size L (Figure 3.2 a), the 
simplest conventional choice is the free boundary condition, where we do not involve any kind 
of link between different boundaries, but let dangling bonds on the circumference. This case 
is suitable to study such problems where free edge boundaries are more realistic, like modeling 
local surface effects which arise on the boundaries of different matters. 





Figure 3.2: Two dimensional square lattice with free boundary condition (a) 
condition (b) and periodical boundary condition (c). 



half periodical boundary 



If we link two opposite boundaries of a square lattice, as we connect each last node to the 
first node of a given row, it forms a cylinder (Figure 3.2 b). Here parallel with the periodical 



condition, the system is homogeneous and the correlation length is maximally L/2. The name 
of such a geometry is the half periodical condition. Another cylindrical structure, which is the 
easiest to implement, is the helical (also called screw periodical) boundary condition, where the 
nodes of the lattice sit on a one dimensional chain and wrapped around the system. Practically 
in the end of the chain the very last node connected to the very first node and cause an 
inhomogeneity which is only negligible in the limit of infinite size. 

The d dimensional lattice which has periodical boundary condition in each d direction covers 
a d+ 1 dimensional torus (Figure 3.2 c). Here the system is translational invariant in each 
directions, and eliminates every boundary effects, however the correlation length is still reduced 
by the system size so finite size effects arise in the system. 

Another boundary condition which reduces finite size effects, and which does not need any 
additional edges is the mean-field boundary condition. Here an additional external field is in- 
troduced on the boundaries, which induces the mean bulk conditions on the borders, eliminates 
boundary and corner effects. 



3.3 Geometrically disordered graphs 

A spontaneously evolving network in the real world usually follows rules which are controlled 
by random properties. Such self-organized systems exclude regularity and show a fairly different 
structure which finds its origin in special features like dynamical growth or randomness. In the 
following section we are going to overview the brief history of random networks and define 
general models which belong to this segment. 
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3.3.1 Random graphs - Erdos-Renyi model 

In the 50s Solomonoff and Rapoport [97] and independently Erdos and Renyi [12-14] were 
the first to define a random graph model in order to describe real world nets. They supposed 
that the networks in nature are driven by uncorrelated random rules, and they defined a simple 
model, later called Erdos-Renyi model, which produces a graph (called random graph, Poisson 
random graph or Bernoulli graph) where each pair of nodes connected randomly with a given 
probability p. 

There are two equivalent definitions for random graphs. In the one was given by Erdos and 
Renyi [12], they proceed from N labeled nodes connected with n edges, which are randomly 
chosen from the possible N ^~ 1 '> . Such graphs Gm,u with N nodes and n edges form a prob- 
ability space, where each realization appears with equal chance. The other definition called 
binomial model start from N separated nodes, where every pair of nodes is connected with a 
given probability p. Then the expectation value of total number of edges in a Gn, p graph is 
E(n) — p ^t^ -1 ) _ j n other words Gjv iP is an ensemble of all such graphs where a graph with n 

N(N-l) _ 

edges is realized with probability p n (l — p) 2 n . 



Degree distribution 

The P(k) degree distribution of the Erdos-Renyi graph follows a binomial distribution: 

P(k)=( N ~ 1 )p k (l-p) N - 1 - k (3.1) 

where p k is the probability that k edges are present, (1— p) N ~ 1 ~ k is the probability of absence 
of additional edges and ( N k ^ 1 ) is the number of ways to select endpoints for the present k edges. 
If the size N tends to infinity, this binomial form transforms to a Poisson distribution: 

P{k)=e-«»-V * N - 1)k =e-M«£ (3.2) 

where we denote the average degree as (k) = p(N — 1) ~ pN. The Poisson distribution implies 
that a random graph can be characterized by an average degree without a significant deviation 
of any other degree. 



Topological phase transition 

Varying probability p, the topology of a random graph passes through a percolation type 
phase transition, where the following phases are located: 

• If (k) ~ pN < 1 the edge density is low, the graph contains isolated trees, and the cluster 
size distribution is exponential. The diameter (here the longest path length) of the graph 
commensurate with the diameter of a tree. 

• If (k) > 1 a giant component appears which holds most of the vertices. The diameter of 
the graph equal to the linear size of the giant cluster. 

• If (k) > ln(iV) the graph is fully connected. 

The critical point is located where (k) ~ pN = 1 consequently at p c — 1/N. 

It is possible to calculate the size S of the giant cluster which plays the order parameter role 
in the phase transition [98-100]. Denote w the probability that a randomly chosen point does 
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Figure 3.3: Demonstration 
of the topological phase 
transition in random graphs. 
Increasing the mean degree 
per site, the S size of giant 
component grows at the 
critical point and the mean 
component size (s) diverges. 



not belong to the giant cluster, in other words P w (k) — w k is the probability that the chosen 
point with degree k does not have any neighbours in the giant cluster. Averaging it over P(fc), 
w goes as 

w = J2PkW k = e-^J2-^ L = ^ k)(w ' 1) (3-3) 

k=0 k=0 

consequently the fraction of nodes belonging to the giant component is given in a self consistent 
form as ,5 = 1 — w = 1 — e~^ s . 

We can calculate also the specific heat like parameter (s), which is denned as the mean size 
of the components where a randomly chosen node belongs. It goes as (s) = 1 _^ 1 _^ s , and at 
p c it has a singularity. Even S and (s) do not have a solution in a closed-form, it is easy to see 
that if (k) < 1, the only non-negative solution of S is S = and if (k) > 1 the finite solution is 
rational to the size of the giant cluster. The phase transition point is located at (k) = 1 where 
(s) diverges and the giant component appears in the graph. Figure 3.3 demonstrates such kind 
of transition. 



Graph properties 

The spectral density also presents different behavior in the two separated phases. When a 
giant cluster occurs in the graph, the density shows a semicircle distribution [94], where the 
largest eigenvalue dominates. In the other phase, when trees are present typically, the spectrum 
deviates from this semicircle because the odd moments are missing since it is impossible to have 
any closed walk with odd number of step in the graph. 

The average path length £ of a random graph can be studied by the mean number of neighbors 
at distance £ separated from a given vertex [101-103]. The mean number of the nearest neighbors 
is (k) so approximately (k) e number of vertices are located at a distance £ or closer to a chosen 
point. Hence (k) e ~ N so the average path length £ ~ / °^^ — ^(^n) ^ s small even for large 
networks. 

Reconsidering the clustering coefficient for random graph, it is possible to give a different 
but an equivalent definition as before. In random graphs, the probability that two neighbors of 
a chosen vertex are connected is equal to the probability that two randomly chosen nodes are 
connected [16], which is P — C ran d = ^y-- Following this definition, the clustering coefficient is 
size dependent. 
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A generalization of the random graph model which is suitable to produce a graph with 
arbitrary degree distribution is the configuration model. Here first we define the P(k) degree 
distribution, and then following the chosen statistic, we assign a degree to each node in the 
graph. After we randomly pick up pairs of stubs and connect the chosen vertices together, we 
can produce every possible topology of a random graph with an optional degree distribution. 



Adaptability 

Even though the random graphs have short average path length, most of the other properties 
do not correspond to real world networks. It shows a Poisson degree distribution with expo- 
nential tail for large k and the clustering coefficient depends on the system size which features 
are usually uncharacteristic for empirical networks. These three major properties characterize 
the random graphs and any deviation from these must be explained by non-random processes, 
which drive us to real world behavior. However the importance of the Erdos-Renyi model and 
random graphs are indisputable since they induced the base of a new science and gave many 
tools which became crucial to characterize many real and theoretical networks later. 



3.3.2 Small-world networks - Watts-Strogatz model 

The small-world phenomena first appeared in literature in 1929 in the novel Chain [104] 
published by a Hungarian writer Frigyes Karinthy. In his short story he wrote about six steps 
of separation between any randomly chosen people around the world. This 'six degrees of 
separation' was first proven by Stanley Milgram in his famous experiment in 1967 [105], where 
he examined the average path length in social network of people in the United States. In his 
research he sent letters to randomly selected citizens in the US, who had then to forward those 
to their friends. Milgram counted the number of steps after the letters arrived back to him 
and found the average path length I = 5.5. After that in the following decades the small-world 
effects had been found in various type of networks and worked around in many scientific papers. 

An approach of the previously described real world networks was defined by Watts and 
Strogatz [92,106,107] in the so-called small-world model, which makes transition between regular 
and random graphs. Their definition proceed from an initial one dimensional regular graph with 
periodic boundary condition - a chain - where each vertex is linked to its first K neighbors in 
both direction. Then, going through all the vertices, each edge is rewired with a probability 
p, and an opposite ending point is chosen randomly. When p = (Figure |3.4|a) the network 



keeps its initial regular structure, but when p — 1 (Figure 3.4 c), the network transforms to 
a random graph. The clustering coefficient at p = is large, C = (3K — 3)/(AK — 2) which 
tends to 3/4 for large K. However the average path length is long I — L/AK for large L since a 
regular lattice does not show a small-world behavior and the average distance between vertices 
goes as N 1 ^. When p — » 1 the system relaxes to random network, where i — (lnL)/(lnX) and 
the clustering coefficient becomes lower: C ~ 2K/L. 

A modified definition was given by Monasson [108] and independently by Newman and Watts 
[109, 110] where they kept the original regular chain but gave additional shortcuts between 



randomly chosen vertices (Figure 3.4 d). The probability p here gives the density of these 
additional edges. This model for sufficiently large L and small p is equivalent to the original 
Watts-Strogatz model. 



Average path length 

Proceeding from a regular 'large- world' lattice, where £ — L/AK, and varying p from to 
1 the graph passes through a structural change and arrives to a random 'small-world' graph 
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Figure 3.4: The evolution of the Strogatz- Watts network. Starting from a regular ring (a), following 
the rewiring process (b), it arrives to a random graph structure (c). A alternative definition (d), where 
only shortcuts are added to remaining original ring. 



where I = (InL) / (InK) . In between this two phases there is a crossover regime, where i begins 
to decrease drastically (Figure |3.5[ ) . The reason of this falling is that the additional shortcuts 
which appears first at p > l/NK, decrease suddenly the geodesic distance between opposite 
parts of the graph. Many attention have been focused to determine the behavior of I in this 
range, but it is still not exactly solved. A widely accepted explanation that I satisfies a scaling 
relation [111]: 



i~Z9{Llt) and g(x) = 



x if x <C 1 

hx(x) if x > 1 



where the correlation length scales as £ ~ p 1 / d [112]. Using renormalization group treatments 
[113] an equivalent scaling form has been found: 

t~^f(L/Q (3.4) 



which differs only by a factor K and where £ = 1 /pK. According to the scaling form in Eq 3.4 
the graph can pass through the transition controlled by p or L as well, since LKp is equal 
to the mean number of shortcuts, which induce the topological change. Finally a mean-field 
treatment [114] of the model in one dimension shows approximately that: 

1 x £ i 1 

fix) = — tanh -1 ^ and so 1= ^tanh -1 — — — (3.5) 

2Vx 2 + 2x Vx 2 + 2x 2KyJl + 2^/L l + ^/L 



Clustering coefficient 

The clustering coefficient, which is large at the initial regular graph, is invariant of the system 
size L at p — since it depends only on the coordination number z = 2K of the lattice. If 
disorder is introduced into the system by rewired edges, it remains close to C(p — 0), as long as 
a large fraction of original neighbors keep connected. The probability that three vertices which 
were connected at p — still construct a triangle when p>0is(l — p) 3 , since there are three 
edges which need to keep intact. It follows that the clustering coefficient changes as [115]: 

— 3 

C(p) = C(0)(l-p) 3 = (3.6) 



36 



COMPLEX NETWORKS 



while for the alternative definition, where instead of rewiring edges, only shortcuts are added 
to the system, C(p) behaves as [116] 



C(P) 



{3K - 3) 



(4K - 2) + 4Kp(p + 2) 



(3.7) 
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Figure 3.5: The clustering 
coefficient C'(p) and aver- 
age path length £(p) of the 
Watts-Strogatz network in 
the function of rewiring prob- 
ability p. For convenience 
C(p) and l(p) were divided 
with their maximal value 
C{p = 0) and £(p = 0). 



Degree distribution 

Since in the Watts-Strogatz model the initial network is regular and the degree of each vertex 
is k = 2K, the degree distribution Pws(k,p) at p — is a delta function at 2K. On the other 
hand, a non-zero p introduces disorder into the network, which broadens the degree distribution, 
but maintains the average degree around k = 2K. The degree distribution for p > follows a 
Poisson distribution, since the network is homogeneous and relaxes into a random graph. 

During the rewiring process only one end of a chosen edge is reconnected, so each node has 
at least K neighbors in the end. It means the network remains connected for each p if K > 1. 
The real connectivity of a node can be written as Ci = K + n%, with n,; > 0, where rii is the 
number of additional connections that a node has beyond K [115]. These rij number of edges 
can be of two kinds also: it contains n\ edges which the rewiring process left unchanged with 
probability (1 — p) and nf — rii — n\ number of edges which became connected (each with 
probability p/(N — 1)) to node i during the process. The probability distribution of these two 
kinds of edges can be written as: 

PM) = ( K \l-p) n h K " nl and P 2 (nf) = {K ^e^ K (3.8) 

\ 71.. / 71.. ' 



if N ^> 1, the complete degree distribution turns into: 

min(k— K,K) 



Pws(k) = J2 



n=0 



(l-p)"/-x^- ^e-? K if k>K (3.9) 

n J (k — K — n)\ 



However this Pws(k) degree distribution can never be identical to the degree distribution of 
a random graph, since in the latter case the graph can contain isolated components, while a 
small- world network is always connected. 
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Real small-world networks 

Following Milgram's experiment the 'six degrees of separation' phenomena were characterized 
in many other real world networks [117]. For example the same behavior was found in e-mail 
networks too, with an average path length between five and seven [118]. A few experiments 
arc in progress to characterize small-world behavior in nowadays popular community sites and 
instant messaging services. 

In collaboration networks, there are two well studied examples of small- world behavior. One 
experiment was defined on movie-actor collaboration network in Hollywood, also called 'The 
Kevin Bacon Game' [92, 106], and another collaboration network can be defined in science 
between researchers who have common publications [119-121]. Both networks show small-world 
behaviors with smaller average path length than six, but these networks have an additional 
property. Namely, their structure is non-homogeneous and their degree distribution follows a 
power-law, what we are going to discuss in the following section. 

3.3.3 Scale-free networks - Barabasi- Albert model 

Many self-organized networks in the Nature show such kind of dynamical behaviors, which 
were not included in the earlier network models. These dynamics induce a sufficiently different 
structure for these systems. The dynamical growth seems to be an actual request for real- world 
network models, however an other important role influences the evolution which drives strong 
inhomogencity into the evolving network and produces degree-distribution with a power-law 
tail. 

The citation network of scientific paper was the first example which was found and showed 
scale-free behavior studied by Price in 1965 [122]. He counted the directed citations between 
papers and found the in- and also the out-degree distributions following power-law degree 
distribution as: 

P(k) ~ Ak-'< (3.10) 

He then developed a model [123] where he gave an alternative description of inhomogencity. His 
idea was based on the "the rich get richer" theory of Simon [124], namely that a paper which 
was published earlier and became popular has larger probability to obtain new citations than a 
paper without many references. He called this phenomenon "cumulative advantage". However 
these kind of systems had difficulties to be studied since strong computational resources were 
not accessible at this age, so Price's idea was forgotten almost for three decades. In the late 90s 
this phenomenon was re-found in some other type of networks, using computational methods, 
and has been enduring popularity up to date in many segments of research. 

Barabasi- Albert model 

Barabasi, Albert and Jeong were the first who studied the structure of the World Wide 
Web (WWW) where the nodes of the network were defined as the websites and the edges 
were the directed hyperlinks between them. It turned out that a few extremely connected 
website hold most of the links in the network, and beyond these sites the largest part of the 
webpages were slightly connected. They found a power-law behavior for the in- and out-degree 
distributions, and gave a relevant explanation for the growing dynamics of the network. Their 
model of evolving networks, today called scale- free model or Barabasi- Albert model, is excellent 
to simulate systems which show scale-free features. Such properties were found later in biology, 
sociology, technology and in many fields of the science. 

In their model they included the dynamical growth and the above described inhomogencity 
role, which they called "preferential attachment". The model contains the following steps: 
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Algorithm 1 Barabasi AlbertModel(mo, m, t) 
1: Starting from a fully connected graph with mo vertices 
2: for all timestep t do 
3: add a new node with m(< mo) edges 

4: for all m number of edges proceed from the new node do 

5: choose a node i to which the new node connects with a probability rational to its degree 

such that: H(ki) = . 
6: end for 
7: end for 



This model was defined on undirected graphs and gave a degree exponent 7 = 3 (Figure 
3.6 1, which is a good approach for the exponents of real world networks. It can be solved in 




Figure 3.6: Degree distribution of Barabasi- Albert network for various m with system size N = 300000. 
The slope of the skew line is 7 = 3 and gives the power- law degree exponent. In the inset we demon- 
strate, that the degree distributions are independent of m after rescaling as fc~ 7 ~ P(k)/m 2 . The fitted 
line gives the expected exponent 7 = 3. 



the large size limit with an approximate solution given by Barabasi and Albert [15,125], and 
it can be proved exactly with two another equivalent methods: the master equation approach 
published by Dorogovtsev et.al. [126, 127] and rate-equation approach introduced by Krapivsky 
et.al. [128]. For these solutions see Appendix |B] 

Types of correlation 

There are two types of correlation in evolving Barabasi- Albert networks found by analytical 
studies [129]. The first nontrivial correlation is between the age and the degree of a node. 
The vertices, which were added earlier to the network had better chance to acquire edges, so 
these nodes have higher degrees. For the case m — 1, when the evolving graph is a tree, the 
probability distribution of the degree of vertex i, with age a (the elapsed time since i was given 
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to the network) is: 



m " )= ' ' _ A" (' _ X/ 1 _ A' ] (:U1) 



so the degree distribution for nodes with fixed age decays exponentially, with a characteristic 
degree scale which diverges as (k) <~ (1 — (a/TV)) -1 / 2 if a — > JV. It means that young nodes 
(where a/t — ► 0) have typically small degrees, while for the older ones the average degree is large. 
This age-degree correlation was not found in real networks [130], however using an extension, 
called fitness parameter [131,132], this correlation can be reduced in current model too. 

The other type of correlation was found between the degrees of adjacent vertices [129]. If 
Njk denotes the number of edges which are connecting two type of nodes with degree j and k, 
in the case when m = 1 : 

4 7 



(k + l)(fc + 2)(j + k + 2)(j + k + 3)(j + k + 4) 

12j 



+ 



(k + + k+ + k + 2)(j + fc + 3)(j + fc + 4) 



It is independent of the time and depends on k and j only, suggesting that the correlation evolves 
spontaneously between the degrees of adjacent vertices, unlike in classical random graphs, where 
the degrees of connected nodes are uncorrelated [133]. 



Graph Properties 

The most important property of the Barabasi-Albert network [16] is its degree distribution 
that follows a power-law. This feature comes from the growth and preferential attachment 
roles which take place together in the model. To find, which property is responsible for the 
spontaneous evaluational scale-free feature, we can analyze these independently If we study 
a growing network with equal probability attachment, it evolves to a graph with exponential 
degree distribution. However if we keep the network size constant and introduce edges following 
the role of preferential attachment, the network evolves into a state where all nodes have the 
same degree. Consequently both properties need to evaluate a network with a power-law degree 
distribution. 

The average path length I of a Barabasi- Albert network is smaller than a random graph 
having the same system size. It means that through the few well connected nodes, all the 
vertices are located closer to each other in the network than in a homogeneous topology. That 
is why the scale- free network is called ultra small- world network in this sense. I is growing 
logarithmically with the system size, but nevertheless there is no exact theoretical expression 
for the average path length. 

There is no analytical prediction also of the clustering coefficient for scale-free graphs. Even 
this property in Watts- Strogatz networks is independent of the system size, here it has a strong 
size dependence. It decreases faster with the system size than in random graphs, and follows a 
power-law C <~ N~ a with an exponent a — 0.75. 

The spectral density for the Barabasi-Albert networks shows a fairly different shape than we 
saw for random graphs [94, 134]. It has a continuous distribution and form a triangle where 
the edges have power-law tails. The first eigenvalue Ai is separated from the main bulk of the 
spectrum like for Erdos-Renyi graphs, and it increases approximately as Ai ~ N 1 / 4 . 

The Barabasi-Albert model has exceptional popularity, since it was first published, and many 
variation appeared to make it more realistic e.g. introducing fitting parameter we mentioned 
before. Another modification when we let the attachment probability II(fc + fc ) to depends on 
an additional constant k too, instead of k only. Modify fco between — m < fc < oo, it scales 
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the degree distribution [126, 129], which then goes as P(k) ~ k~ e , with e = 7 + k /m, where 
7 = 3 the original degree exponent. 

If we scale the attachment probability as a power-law U(k £ ) and not linearly as before, when 
e = 1 we get back the original graph, however if e < 1 or e > 1, different network behaviors 
appear [128,129]. 

Another variation of the model is given if we increase the average degree over time [135] . It 
seems to be realistic, since in the WWW the average degree increasing by time as well. This 
modification varies the degree exponent too, and approximates more the original Barabasi- 
Albert network to real systems. 

Real scale-free networks 

Such kind of systems which shows a power-law degree distribution can be found in various self- 
organized systems. In social science the first found example was the citation network [122, 123] 
of scientific papers, what we have already discussed. However human sexual networks [136], the 
word web of human languages [137] or the above-mentioned collaboration networks following 
scale-free behavior too [92,106,119-121]. In technology, electric circuits [138], phone-call nets 
[139] or airplane networks has scale- free topology, and after the WWW [140,141], some other 
information network, like the Internet (defined as the network of wired rooters) indicates the 
same behaviour also [142,143]. We can find various type scale independent biological system 
too, like cellular networks [144-146], protein folding networks [145,147], ecological and food 
networks [148,149] or the net of metabolic interactions [144]. 

These various examples prove that self-organized networks in Nature are not driven by only 
random rules, but follow such universal laws which introduce a type of order into the system. 
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Chapter 4 



Numerical methods 



The numerical physics became a sterling part of the science of physics since high-performance 
computational engines and methods became available from the middle of the 20th century. The 
main expediency of numerical simulations is two fold, related to the theoretical and experimen- 
tal part of physics and other segments of natural science. In many cases theoretical treatments 
are available for models for which there is no perfect physical realization (at least at the present 
time). In this situation the only possible test for an approximate theoretical solution is to com- 
pare with numerical results generated from a computer simulation. There are also real physical 
systems which are sufficiently complex that they are not presently amenable to theoretical 
treatment. An example is the problem of understanding the specific behavior of a system with 
many competing interactions and which is undergoing a phase transition. Following this two 
directions many numerical methods have been developed in the last few decades what we can- 
not discuss here [40] . In this chapter we confine oneself to the methods only we applied during 
our work or strongly related to the subject of statistical physics and Monte Carlo simulations. 
After a brief introduction into the base idea of general Monte Carlo methods we discuss shortly 
the subject of combinatorial optimization and its application what we used intensively in the 
course of our work. We close this chapter with a short discussion of an effective algorithm to 
simulate scale- free networks. 

4.1 Principles of Monte Carlo methods 

The subject of Monte Carlo methods in physics is to calculate thermodynamical averages of 
observable quantities in interacting many body systems. These numerical methods are based on 
stochastic techniques and use random numbers and probability statistics to study and simulate 
problems on computers. In this chapter we are going to discuss the general ideas of Monte 
Carlo methods and review algorithms which are related to our purpose. 

4.1.1 Importance sampling 

Lets take a lattice system at a temperature T which contains N particles [40-42]. The time 
evolution of the system can be described as a serial of states which the system goes through at 
given state space. Suppose that the system is at the state /i at time t and define a transition 
probability R(fi — > v) that it is in the state v a dt time later. We can determine the dynamics 
of the system thus we define such a rate for all possible states v that the system can reach. If 
we introduce a set of weights w M (i) which gives the probability that the system is in the state 
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/i at time t then the time evolution can be described by the master equation: 

dWn(t) 



dt 



[w v R{v -f fx) - w„R(fx i/)] (4.1) 



where the first term on the right hand side represents the probability that the system gets into 
the state [i while the second terms is the probability that it leaves that. Since the system at any 
time t must be at one of the points of the state space then the weights must obey Wfi{t) = 1- 
The expected value of some quantity Y at time t then can be written as: 

(Y) = Y / Y^(t) (4.2) 
In equilibrium when the transition probabilities between two states are equal 

the right hand side of the master equation is canceled out and all weights become constant 
since dw ^it) / dt = 0. For thermodynamical systems the equilibrium values of are known a 
priori exactly and define the equilibrium occupation probability in the infinite time limit as 
= lim^oo Wfj,(t). For canonical systems in equilibrium this probability (as it was already 



described in Section|2.2.1 1 is following a Boltzmann distribution [150]: 



p M = \-e fm » thus the average of quantity Y is (Y) = i Ke (4.4) 
Z Z z — ' 



where Z is defined in Eq |2.2| 

This average can be calculated only for small systems which have sufficiently enough number 
of states. However the energy of an equilibrated system changes only on a small scale, which 
means that the system occupies only a limited number of state with a large probability and 
has small but not zero chance to reach the rest of the state space. It is straightforward from 
the quantitative image that the number of states is reduced as the temperature approaches 
zero since the system does not have energy to reach excited energy levels. If we follow this 
consideration thus instead of measuring on all states but we make a representative selection M 
of the most proper states, then average quantities can be calculated over this state set M with 
acceptable accuracy. Now if we define a distribution p M to select randomly the important states 
/ii, [Im € M from the complete state set then an estimator of a quantity can be calculated 
as: 



Ym = ^ "I" (4.5) 



which becomes a more accurate estimate of (Y) as the number of states in M increases and 
when M ->• oo then Y M = (Y) . 



As a first approximation if we choose p M equal for each state then we get back to Eq 4.5 
However we have seen that the range of energies of the states sampled by a typical system is 
very small compared with the total energy. So the system does not sample all states with equal 
probability but samples them according to a Boltzmann distribution. Then a better strategy 
would be not to pick up the representative M state with equal probability but proportional to 
its Boltzmann weight. Now we can define the probability that a particular state \x gets chosen 
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as Pa = 2, 1 e * so the estimator is simplified to: 

1 M 

Y m=mT, Y ^ ( 4 - 6 ) 

i=i 

where the Boltzmann factors have canceled. This approximation works much better since we 
pick up most properly the states where the system spends the majority of time, with a relative 
frequency corresponding to the time the system spends there. This method of importance 
sampling was one of the base idea of Monte Carlo methods and commonly used in many 
algorithms. 

Now the question arises how to choose these proper states from the state space since choosing 
randomly and then accept them with probability e~^ w ' 1 is still not effective. Almost all Monte 
Carlo schemes rely on Markov processes to generate the set of these states. It is a mechanism 
which transforms the system into a new state v, with a transition probability R(fi — > v), if the 
system was in the state fi before. It chooses the new state v in a random manner from the set 
of possible transitions corresponding to the transition probabilities, which probabilities need to 
satisfy the constrain 

£i?( M ^) = l (4.7) 

V 

By definition the transition probabilities must be time independent and the choice of the new 
state v depends only on the properties of the former state fi (in other words the system has no 
memory) . 

The serial of states which was generated by a repeatedly applied Markov process is called 
Markov chain. We can specify the Markov process thus when we start the system from an arbi- 
trary state, after enough iterations the states appear with a probability given by the Boltzmann 
distribution. Then the system reaches its equilibrium. To ensure this specialty for the Markov 
process the system needs to satisfy two conditions. 

The ergodicity is the first required but not sufficient condition which means that the system, 
started from any initial state /i, should be able to reach any other state v in the state space, via 
the Markov process if we run it long enough. This condition is required since each state appears 
with a non-zero probability in the Boltzmann distribution. However in an ergodic system if a 
transition probability between two states is i?(/i — > v) = it does not mean that the system 
cannot reach the state v initiated from fi. In real systems most of the state transitions are 
forbidden, but there exists a sequence of transition between each state where the intermediate 
transitions are allowed. 

The other condition we place on our Markov process is the condition which ensures that it is 
the Boltzmann distribution that we generate after the system reaches its thermal equilibrium. 
A system is in equilibrium if it is true for each states that the probabilities to get in a state and 
leave that are equal to each other, as it was drawn in Eq |4.3| We can simplify this expression 
apply Eq |4.7| and write to the form: 

p„ = ^p»R{v^ fi) (4.8) 

V 

However this condition still does not guarantee that we reach the equilibrium from an arbitrary 
initial state and we need one more consideration related to the Markov process: 

p„R{fi -4i/)= p v R{v -> fi) (4.9) 

which is called the condition of detailed balance. It tells us that the average rate of transforma- 
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tion between two states is equal and independent of the direction which is always the case for 
real systems also. 

Now if in the Markov process we suppose that the p M distribution of states satisfies the 
condition of detailed balance and we wish the equilibrium distribution to be the Boltzmann 
distribution, rearranging Eq |4.9[ it tells us that the transition probabilities should relate as: 

R{^v) P^ = e - mu -n») (410) 



This constrain with the one defined in Eq |4.7| limits the transition probabilities, but if the 
Markov process obey these and our system is ergodic then the equilibrium distribution of states 
will follow a Boltzmann probability distribution. 



If we choose the transition probabilities of the form of Eq 4.10 during the simulation the 
system can be trapped in a intermediate sate for a longer period or even locked for the whole 
processing time. It happens if the chosen transition probabilities are even correct Boltzmann 
probabilities but those are too small to change the current state. A solution is to brake the 
transition probabilities into two parts as R(fi —►!/)= g(fx — ► v)A(fi — > v) where g(fj, — ► v) 
defines a selection probability and gives the chance that the system in sate /i will choose the 
state v as a next state during the Markov process. A{ji — > v) is the acceptance ratio which 



gives the ratio of the acceptance of the transition, chosen by g(/i — > v). Then the Eq 4.10 
be rewritten of the form 

9 {H -> iy)A(fi -> v) = Pu = ^ m ^ H)i) (4 n) 

g{v -> n)A{v -> (i) 

which equation still satisfies the detailed balance but the ratio A(fi — > v)/A(y — > fx) can be 
arbitrary chosen between zero and oo which means that the selection probabilities can take any 
values we wish. The best choice if the acceptance ratios are close to one. If we fix their ratio 
for every transitions then the selection probabilities can be scaled arbitrary if we multiply the 
counter and denominator with the same number. An average choice to set the larger selection 
probability to one and gear the other probability to that. This modification can significantly 
fasten up our simulation while the system still satisfies all the required constrains. 



4.2 General Monte Carlo algorithms 

In the following section we are going to introduce general Monte Carlo algorithms of statis- 
tical physics which are capable to simulate phase transition at finite temperatures. All of our 
considerations will be drawn with the Ising model paradigm, however all of our discussions are 
relevant for other models too. The nearest neighbour Ising model here is defined on a finite 
size lattice with N sites and periodical boundary condition to eliminate boundary effects. The 
initial state of the simulated system usually is a completely ordered ground state belonging to 
T = or a random state defined as the T = oo limit. 

4.2.1 Metropolis algorithm 

The most frequently used method to simulate spin lattice models is the Metropolis algorithm 
which was firstly defined on simulation of hard-square liquids in 1953 [17]. Here we use a single 
spin-flip techniques to generate a new state from the current state of the system. Since the 
system size is N and each spin can choose between two directions <Ji — ±1, the total number 
of the states is 2 N . But if we flip only one of the N spins at each iteration, the system has N 
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different v states which can be reached from its current state /i. Then if we choose the selection 
probability <?(/i — > v) equal for each possible state transition /i — > v thus there are N non-zero 
selection probabilities, that take the same value g(/j, —> v) = l/N, otherwise they are zero [42]. 
Substitute it into the Eq 4.1 1| we get the form: 



R(v -> ju) A{v -> fx) 



e-Wv-HJ (412) 



This ratio depends only on the energy difference AE = — TL^ between two states at a 
given temperature. Now we can choose any acception rate which satisfies the detailed balance 
condition. Historically the first choice was the form of Metropolis [17]: 




, . if AE > ,„.,„. 

A(ji^u) = {, • ( 4 - 13 ) 

otherwise 

where we set the larger acceptance probability to one and scale the smaller pro rata as we 
proposed to do in Section f4.1.1| Eq |4.13| means that we accept every transition which does not 
increase the energy of the system, otherwise we take it with a Boltzmann probability depending 
on the energy difference. The implementation of this method is simply defined in Alg|2] where 
one Monte Carlo step (MCS) is recognized as N complete for iteration between the lines 3 — 8, 
thus that each spin could be chosen at least once per a MCS. The choice of spins in the 4th line 



Algorithm 2 Metropolis() 
l: Choose an initial state 
2: for 1 to N AIC s do 
3: for 1 to N do 

4: Choose a spin <jj 

5: Calculate the energy change AE which results if the spin at site i is overturned 
6: Generate a random number such that < r < 1 
7: Flip the spin if r < e _/3AB 
8: end for 
9: end for 



can be systematic or done by random fashion. 

One of the slowest part of the algorithm is to calculate the energy difference of the system 
between the current state and after we flip a spin. However the energy of the initial and final 
state in one iteration depends only on the relation of the chosen spin and its direct neighbours 
since the Hamiltonian contains interactions for only first neighbours. So we need to calculate 
the energy difference on the first neighbour terms only and the energy of the rest of the system 
stays invariant during the iteration. Another trick may be applied if the lattice is regular and 
the number of neighbours is the same for each spin. Then the variation of the states of the 
chosen spin and its first neighbours is finite. So, if we calculate initially the energy difference for 
all these substates then during the iterations we do not need to recalculate always the energy 
but only pick up the related pattern. 

After the system has reached the equilibrium, to calculate an average quantity we need to 
measure in different MCS which are related to independent states. Such kind of time average 
and the multitude average over samples in equilibrium are equal in ergodic systems. 
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An alternative method exists which defines the single spin-flip transition probability as [151]: 

R(H -> v) = 1 + aita,nh(f3Hi) (4.14) 

where c{Hi is the energy of the ith spin in state fi [40]. This method commonly called the 
Glauber dynamics gives the same results as the Metropolis dynamics, however in the high 
temperature limit it stays ergodic unlike the Metropolis method [152]. 

4.2.2 Cluster algorithms 

A more efficient class of algorithms to simulate lattice systems are the cluster-flip algorithms. 
Here instead of flip spins one by one we flip whole clusters of neighbouring spins which are at 
the same spin state. However the cluster selection techniques is not trivial since the size of 
clusters should depends on the temperature. Swendsen and Wang were the first who defined a 



relevant method, using the Fortuin-Kasteleyn transformation (see Section 2.3.21 in their Monte 
Carlo algorithm [18]. Following their idea Wolff found a different algorithm which was proven 
to be faster in higher dimensions [19]. 

The common idea was to evaluate clusters of neighbouring spins which are at the same state, 
by adding bonds between them with a probability p a dd = 1 — e~ 2l3,J (following the same method 



like in Fig A.l b). In the Swendsen- Wang algorithm at every MCS we divide the whole lattice 
into clusters and then turn each cluster with a probability 1/2. However in the algorithm of 
Wolff we proceed from a randomly selected spin and clustering (with p a dd) only that domain 
where it belongs to. Then we turn the selected sub-domain with probability 1. 

The probability p a dd scales with temperature and shapes small clusters at high temperatures, 
but it assembles large amount of spins at the low temperature phase, where p a dd is large and a 
system wide domain is present. The cluster methods have a special advantage at the criticality 
where they are much faster than any single spin-flip algorithm. 

At the vicinity of the phase transition point, where the correlation length £ becomes infi- 
nite we need to flip many spins to produce uncorrelated patterns. The correlation time then 
diverges as t ~ £ z , where z is the earlier defined dynamical exponent. Since in Monte Carlo 
simulations the system size is always finite, than at the critical point the correlation length 
becomes commensurable to the linear size £ ~ L, which means that the relaxation time r is 
increasing by the system size and causes the symptom of critical slowing down. The cluster flip 
algorithms reduces the effect of this slowing and indicates various dynamical exponents (see 



Table 4.1 1 which identify different dynamical universality classes. 



dimension 


Metropolis 


Wolff 


Swendsen- Wang 


2 


2.167 ±0.001 


0.25 ±0.01 


0.25 ±0.01 


3 


2.02 ±0.02 


0.33 ±0.01 


0.54 ±0.02 


4 




0.25 ±0.02 


0.86 ±0.02 



Table 4.1: Different values of dynamical exponents for the Metropolis, Wolff and Swendsen-Wang 



algorithm at different dimensions [42]. As we see in Table 4.1 the Wolff algorithm is faster in higher 
dimensions, but in two dimensions in case of any applied external field the Swendsen-Wang method 
provides a faster solution. 
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4.3 Combinatorial optimization 

Combinatorial optimization is a method to find extremity of different quantities and calculate 
their correct values numerically. Instead of examining all states of a finite system which can be 
done only in t ~ e L non-polynomial time (NP-complete problems) , here we exploit some special 
feature which lets us apply algorithmic methods and find a solution in t ~ L k polynomial time 
(P-type problems). In case of a problem that cannot be solved analytically or algorithmically 
we need to apply Monte Carlo methods to calculate average quantities as we discussed before. 

For example to calculate the average free energy of the ferromagnetic random bond Potts 
model, it is necessary to calculate the average over the whole probability distribution P(Jij) 
as: 

/(/?) = J d,h--- J dJ m P{J u ...,J m )f. h ... Jm (P) (4.15) 

which is an NP-complete problem. Here we show how to compute exactly fj 1 ...j m ((3) for a 
particular choice of the couplings Ji,..., J m in the q infinite limit [21]. As we have seen in 



Section 2.3.1 the partition function of the Potts model on a graph G can be expressed in terms 



of its subgraphs G' in the high temperature limit (sec Eq2.48l. When q — oo, the partition 
function can be rewritten in the form of Eq |2.65[ where only the subgraph G* contributes which 
maximizes 4>(G') — c(G') + X^eeG' Then to calculate the partition function and the free 
energy, the problem is reduced to find the optimal subgraph G* which maximizes <fi(G') or 
equivalently minimize: 

MG') = ~(c(G>)+Y,Je) (4.16) 

This function has a special property which allows us to minimize it efficiently using optimization 
methods, which will be introduced in the following. 



4.3.1 Minimization of Submodular Functions 

Lets consider now <j>p(G') as a set function f(A) which are defined as / : 2 E — > K where 2 E 
denotes the set of all subsets of a finite set E. If the cardinality of set 2 E is large, it is impossible 
to calculate all its values in order to find the smallest one, however if f(A) is recognized as a 
submodular function then to find its minimum becomes a optimization problem. 

Definition 4.3.1. A set function is submodular if for all subsets A C V and B C V : 

f(A) + f(B)^f(ADB) + f(AuB) (4.17) 

To find a subset A*, called the optimal set, which minimizes f(A) such that f(A*) < f(A) 
for any A C E is possible in strongly polynomial time. To introduce a method we need to 
consider some other characters of submodular functions. Lets denote fp the function which we 
need to minimize on all subsets of E. Then for any subset F C E we can define a set function 
thus fp{A) = fE(A) for any A C F. This means if fp is a submodular function so thus fp is 
also a submodular function and satisfies the following proposition [21]. 

Proposition 4.3.2. F C E is a subset and e £ E is an element of E. If Ap is an optimal set 
of the set function fp defined on F, then there will be an optimal set A Fu ^ e j of the function 
fpu{e} defined on F U {e} such that Ap C Ap u ^ e y 

This property has an important consequence. If we have found the optimal set A* F for a 
subset F of E then all elements in A* F will still belong to one optimal set Aq of all the sets 
which G D F. It means that we can find the optimal set of E , finding successively the optimal 
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set for its subgraphs. In the following section we use this property to construct a method to 
find the optimal set to minimize a submodular function. 



4.3.2 The Method to calculate the Potts free energy 

It is simple to show that free energy cj)p(G') of the 17 = 00 Potts model, which was defined in 
Eq 4.16 on a graph G — (V,E) is submodular [20]. Using this property we can calculate this 



free energy in strongly polynomial time using combinatorial optimization predictions as follows. 

Let us suppose that the optimal set A* k of the subgraph G t CG has been found and contains 
the vertices 14 = {vq, V\, Vk} with the edges which have both extremities in Vk- Then the 
edges of the optimal set can be grouped into clusters (connected subsets of vertices), where the 
clusters are connected with edges, which are not belonging to the optimal set. The weight Jy of 
an edge between two clusters is defined as the sum of weights of all edges having one extremity 
in each cluster. The isolated vertices are considered as clusters of size one. We know from the 
previous proposition that the current cluster structure will be embedded into the optimal set 
of Gk+i- However when we add a new site to Gfe, then some clusters of A* k (possibly 0) are 
merged together with the new site Vk while the other clusters keep unchanged. So the next step 
is to find the clusters which merge together with the new vertex Ufe+i. 



the new site 




BEFORE 




DURING 




the source 



Figure 4.1: Add a new vertex during the combinatorial optimization algorithm of the random bond 
Potts model. On "BEFORE" and "AFTER" only the edges of the optimal set are presented. Pro- 
ceeding from the subgraph "BEFORE", we add the new site, which connects to the presented sites 
("DURING"). Then the "NETWORK" is generated with the additional source and sink sites as we 
were discussed above with the capacities defined in |4.18|4.20| At the "NETWORK" the thick line car- 
ries an infinite weight and the dashed edges are not belonging to the optimal set. After we calculated 
the minimum cut and some new edges included in the optimal set, signed with thick line at the state 
"AFTER" . 



To solve this problem we introduce another weighted and directed graph, called network (see 



Fig 4.1 1. The vertices in this network are of three kinds: (i) the clusters defined by the optimal 



set A^. in Gk, (ii) the new vertex Ufc+i, (iii) and two additional sites, which we called source s 
and sink t. Between that vertices which corresponds to such clusters which are connected in 
the original graph Gk, we set two directed edges, one in each direction. Moreover we introduce 
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additional edges from the source s to each vertex and from every vertex to the sink t. After 
we defined the network, a convenient selection of edge capacities will reduce the optimization 
problem to finding the minimum cut between s and t which can be solved in strongly polynomial 
time. Here a cut S by definition is a partition of all vertices into two sets S and T such that 
s € S and t € T = S. The weight C(S) of a cut is the sum of edge weights c(u, v), where the 
sites u and v are in different sets of S and T. Then the suitable choice for the capacities: 

c(u,v) = c(v,u) = ^J uv (4-18) 



c(s,v) = max(0,- J uv - 1 ] (4.19) 



U,\ E -^-i) 

c(v, t) = max | 0, 1 - - ^ J uv J 
V uev(u) J 



(4.20) 



where V(u) denotes the set of vertices, different from s and t, linked by an edge to site v. Then 
the minimum cut S which separates s € S and t (£ S in the network, gives the optimal set A* k 
as the set of such edges which have both extremities in S. 



4.3.3 Implementation 

Following the previous considerations we can define an algorithm to calculate the free energy 
of the system as finding the optimal set of the graph G. The algorithm proceeds by computing 
the optimal set on \V\ — 1 sublattice with an increasing number of sites and arbitrary choice of 
adds order. To represent the actual data structure in the computer memory we can use two main 
options. We can construct the whole data structure and rebuild the network after each step, 
or one can define the whole structure in the beginning and increase the edge weights between 
vertices, which are at the same cluster, as large as that those cannot be in other clusters during 
the calculation. The latter case allocates less memory, however the former representation is 
faster since the extra time for building the new structure in every step is largely compensated 
by the smaller network to process. 



Algorithm 3 OptimalCooperation() 

1: Network <= 

2: for all vertex v do 

3: call AddVertexToNetwork(iVeiu>orA;, v) 

4: S <= MmCut(Network) 

5: call ContractNetwork(A^etworfc) 

6: end for 

7: Uncontract all vertices 

8: Optimal Set <= the edge set induced by the cut S 



The optimal cooperation algorithm (see Alg|3] and also Fig 4.1 1 at each iteration includes 
three steps [21]: (i) build the network (Algj4j), (ii) find the minimum cut, (iii) contract all the 
connected vertices on the source side into a single vertex in a way that we can uncontract them 
at the end of the algorithm (Alg{5|. 

The crucial point of this method is to find the minimum cut in a series of \V\ — 1 networks. 
Many algorithms exist to calculate the minimum cut (or cquivalently the maximum flow) of a 
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Algorithm 4 AddVertexToNetwork(Network,v) 



comment connect vertex v to its neighbours sites as in the original graph 
for all neighbours u of v do 

for all vertex x in the network to which u belongs do 
c(v,x) <= c(v,x) + J uv /2 

end for 

c(x, v) c(v, x) 
end for 



connect the source s and the sink t using weights defined in Eq 4.20 and Eq 4.19 



weighted directed graph in polynomial time. We applied the Goldberg&Tarjan and the Ford- 
Fulkerson algorithm in the course of our work which are explained in details in [153]. 



Algorithm 5 ContractNetwork(Network) 
1: Contract the vertices in S into a single vertex v* 
2: comment modify the weights accordingly 
3: for all vertex u not in S do 

4: c(u,V*) <= 

5: for all vertex v neighbour of u in S do 

6: c(u, V*) c(u, V*) + c(u, v) 

7: end for 

8: c(v* , U) <= c(u, V*) 

9: end for 



The optimal cooperation algorithm is running in strongly polynomial time. However the 
running time depends on the distance from the critical point and the different realizations of 
the random bonds. An estimation can be calculated as an average of the execution time of a 
system with a given size but different disordered realizations. This evaluation gives 0(AN 2A ) 
if the size N of the graph is larger than a thousand. 

The previous algorithm does not give any information about the number of optimal sets. 
However we can make some statements about this cardinality if we use the property that the 
union and the intersection of the optimal sets are optimal sets as well. If we calculate now the 
union and intersection of all optimal sets and those are equal, then there is only one unique 
optimal set [21]. 



4.3.4 Exact calculation for random field Ising model at T = 

The minimum cut - maximum flow method is also applicable to find the exact ground state at 



T = of the random field Ising model (defined in Section 2.4.2 1 on an arbitrary graph without 
thcrmalization problems [154]. 

Allow the random field to admit positive and negative values. To define the network we need 
to introduce again two additional points, the sink and the source, and connect all sites v in the 
original graph to the source s if the local field h v > and to the sink t otherwise, if h v < 0. 
Then we define the capacities in the network as follows: 

c(u,v) = c(v,u) = J (4.21) 
c(s,v) = h v (4.22) 
c(v,t) = -h v (4.23) 
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After we calculate the minimum cut of the network, to get the corresponding spin configuration 
we set to +1 those spins which are belonging to the source s and to —1 those which are in 
the set of sink. If the random field is discrete, maybe more than one minimum cut exists with 
the same value so the ground state can be degenerated. Following this method we can find 
the ground state of the random field Ising model with one minimum cut calculation in strongly 
polynomial time. 

4.4 Simulation of scale-free networks 

Many methods exist to simulate a scale-free network with power law degree distribution. 
One of the first defined model was the Barabasi- Albert model that we discussed in detail in 
the Section |3.3.3| This model describes dynamically growing network where the sites, added 
at each time step to the network, choose their neighbours from the already presented sites 
proportionally to their degree. In the corresponding algorithm (AlgjTJ) this rule of preferential 
attachment means to recalculate the attaching probabilities H(ki) (defined in AlgjTJ of all sites 
at each time step which causes an 0(AN 2 ) execution time. 

In the course of our work we applied another but equivalent algorithm to simulate scale- free 
networks. Instead of recalculating all the attaching probabilities at each step we introduced a 
degree map. This data structure is a container of data elements containing unique data pairs: 
a key number which represents a degree k and a list of nodes list(rii(ki — k)) having this 
given degree. At each timestep t we need to update this map only, in a way that the degree 
elements with zero list size are forbidden to be present. The size of this map is smaller than 
the system size if the N is sufficiently large which can be explained with the special structure 
of the scale-free network. Such networks are non-homogeneous thus many sites have the same 
degree, consequently the number of different degrees in the network is much smaller than the 
number of sites. Following this consideration a possible algorithm can be defined as follows: 



Algorithm 6 ScaleFreeNetwork(mo, m, t) 

1: Start from a fully connected graph with mo vertices 

2: Create a degreemap{k 1 list(n)) initially with one clement degreemap{m a — I, listen)) 

3: for all timestep t do 

4: Add a new node with m(< mo) edges 

5: for all m number of edges proceed from the new node do 

6: Choose an element j from the degreemap(k,list(n)) with the probability H(k) = 

kN k 
J2 k kN k 

7: Choose a node ni randomly from the list of degreemap(j, list(n)) to which the new 
node connects 

8: Erase ni from the list of degreemap(j , list(n)) and delete clement j if the list empty 
9: Create degreemap(j + 1, list(n)) if does not exists and insert ni into its node list 
10: end for 

11: Create clement degreemap{m, list(n)) if does not exists and insert the new point into its 

node list 
12: end for 



Double edges are not allowed in the network and Nk denotes the number of sites with degree 
k. Here the time to calculate the probability II(A:) at each time step is in the order of Oni.AN 1 ^) 
following from numerical averages. Consequently the execution time of the whole algorithm for 
large enough size is 0(A/V 4 / 3 ) leads to a faster simulation than the original method. 
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It is easy to see that the AlgjTJand the Alg|6]are equivalent. In the AlgjTJat each step the 
nodes with the same degree have the same probability to receive a new edge and the sum of 
their probabilities must be = 1. In the Alg|6]the situation is the same, but here the 

nodes with same degree and probability are collected into bulks, which is just a special case 
of the AlgjTJ Then we define a probability II(fc) = j^j.% k f° r each bulk, relational to the Nk 
number of nodes in the bulk and to the common k degree they have. These probabilities must 
be normalized ^ fe II(fc) = 1 too. After all to choose an ending point of a new edge is equivalent 
in the two methods since to choose one node randomly with probability n(fc;) where nodes with 
the same probability are allowed or to choose randomly a bulk with probability II(fc) belonging 
to the degree k and then randomly select one node having this chosen degree is the same since 
II(fci = k) = H(k) for each different degree k. 

Consequently the two methods indicate the same type of network following a P{k) ~ fc -7 
power law degree distribution with an exponent 7 = 3 as we have proved in Section |3.3.3| 
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Chapter 5 

Non-equilibrium phase 
transitions and finite-size scaling 
in weighted scale-free networks 



5.1 Introduction 

Complex networks, which have a more complicated topology than regular lattices have been 
observed in a large class of systems in different fields of science, techniques, transport, social 
and political life, etc, as we have seen in Chapter|3] We described previously that such networks 
have connections between remote sites, and are ruled by small world effects. Moreover a non- 
democratic way of the distribution of the links characterizes the system which induces a degree 



distribution with a power-law tail (see Eq3.10). Hence these networks are called scale-free 



In real networks the 7 degree exponent is generally: 2 < 7 < 3 which is usually the result 
of growth and preferential attachment as it was shown by Barabasi and Albert [15]. They 
defined a scale-free network model which is capable to generate a similar kind of graph with an 
exponent 7 = 3, what we have discussed in detail in Section |3.3.3| 

Since the agents of a network interact with one another, it is natural to ask about the 
cooperative behavior of the system. In particular if there exists some kind of thermodynamical 
phase and if there are singular points when the strength of the interaction or other suitable 
parameter is varied (such as the strength of disordering field, temperature, etc.). In this respect, 
static models [155-160] (Ising, Potts models, etc.), as well as non-equilibrium processes [161— 
164] (percolation, spread of epidemics, etc.) have been investigated. However, generally non- 
weighted networks were considered, in which the strength of the interaction at each bond is 
constant. 

Studying cooperative processes on scale-free networks, due to long-range interactions a con- 
ventional mean-field behavior is expected to hold. However it turned out that it is true only if 
the network degree exponent is large enough, i.e. 7 > 7„, when the behavior of the system is 
similar to a high dimensional regular lattice. For the Ising model this upper critical exponent is 
7„ = 5, whereas for the percolation and epidemic spreading j u — 4. As we decrease 7, the most 
connected nodes start to play an important role since they induce strong correlations in their 
neighbourhoods at short distance. At 7 = j u there are logarithmic corrections to the mean-field 
singularities, whereas for 7„ > 7 > 7 C , where j c is a lower threshold value, we arrive to the 
unconventional mean- field regime in which the critical exponents are 7 dependent. The effect 
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of topology of scale-free networks becomes dramatic if 7 is lowered below the lower threshold 
value, 7 < 7c, and the average of k 2 , defined by (k 2 ) = J P(k)k 2 dk, as well as the strength 
of the average interaction, becomes divergent. Then for any finite value of the interaction, the 
scale-free networks are in the ordered state, consequently there is no threshold value of any 
phase transition. Since 7 C = 3, in realistic networks with homogeneous interactions, this type 
of phenomena should always occur. 

Recently, much attention has been paid on weighted networks, in which the interactions 
are not homogeneous. Generally the strength of the interactions of highly connected sites are 
comparatively weaker than the average, that can be explained by technical or geographical 
limitations. To model epidemic spreading, one should keep in mind that sites with a large 
coordination number are generally earlier connected to the network and in the long period of 
existence they have larger chance to be immunized [165]. 

An interesting class of degraded networks has been introduced recently by Giuraniuc et 
al [166] in which the strength of interaction in a link between sites i and j is rcscalcd as: 

where fc, and kj are the connectivities of the given sites. Here < /i < 1 is the degradation 
exponent with which, if fi = 0, we recover the nondegraded network with homogeneous interac- 
tions A. The properties of this type of network in equilibrium critical phenomena, in particular 
for the Ising model have been studied in detail in Ref [166]. Most interestingly the equilibrium 
critical behavior is found to depend only on one parameter, the effective degree exponent, 

7' = (7-M)/(l-M), (5-2) 

thus topology and interaction seem to be converted. One important aspect of the degraded 
network in Eq |5.1| is that phase transitions in realistic networks with 7 < 3 are also possible, if 
the degradation exponent is sufficiently large , /1 > (3 — 7)/2. Therefore theoretical predictions 
about critical singularities can be confronted with the results of numerical calculations. 

In this chapter we study noncquilibrium phase transitions in weighted networks. Our aim 
with these investigations is twofold. First, we want to check if the simple reparametrization 
rule in Eq |5.2| stays valid for nonequilibrium phase transitions, too. For this purpose we make 
dynamical mean-field calculations and perform large scale Monte Carlo simulations. Our second 
aim is to study the form of finite-size scaling in nonequilibrium phase transitions in weighted 
scale-free networks. To analyze our numerical results we use recent field-theoretical calculations 
[167] in which finite-size scaling in Euclidean lattices above the upper critical dimension has 
been studied. In the conventional mean-field regime of scale-free networks, analogous scaling 
relations are expected to apply. 

The structure of this chapter is the following. First we introduce a reaction-diffusion model, 
the contact process, which is the prototype of a non-equilibrium phase transition belonging to 
the universality class of directed percolation. Then we give the dynamical mean-field solution of 
the recent model, and in the following section finite-size scaling theory is shown. Finally results 
of Monte Carlo simulations of the contact process on weighted Barabasi- Albert networks are 
presented. 



5.2 Reaction-diffusion models - The Contact Process 

Reaction-diffusion systems are mathematical models to describe how the concentration of 
one substance or more distributed in space, changes under the influence of two processes: local 
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reactions in which the substances are converted into each other, and diffusion which causes 
the substances to spread out in space. These kind of descriptions are naturally applied in 
chemistry but also capable to describe non-chemical dynamical processes like in biology, physics 
or information science etc. 

These non-equilibrium processes are described by stochastic models where the reactions and 
diffusions are defined as probabilistic transition rules. The state of the system is characterized 
by w^t) which gives the probability distribution that it is in state fi at time t. It can be 
shown that in the limit of very large system sizes, the temporal evolution of the probability 
distribution w^it) evolves deterministically according to a master equation (see Eq 4.1 1. Since 



the state of the system at time t depends only on the previous state, the master equation 
describes a Markov process. Using a matrix notation the master equation may be written of 
the form 

fitM*)} = -£M*)> (5-3) 

where [w^t)) denotes a vector with the components of probabilities in w^t) [168]. The tem- 
poral evolution is governed by the Liouville operator defined through the matrix elements as: 

(fj,\£\p) = -R^ u + S(fi,u)J2R^ (5.4) 

UJ 

where the coefficient denotes the state transition rate from state /i to v and S{fj,, u) = 1 

if only fi — v otherwise it is zero. A formal solution of the master equation is given by 
= exp(— Ct\w fj,(0))) where |u^(0)) denotes the initial probability distribution at t = 0. 
Therefore, in order to determine \w^(t)}, the Liouville operator has to be diagonalized which is 
usually a nontrivial task. 

In the following we will focus on simple reaction-diffusion lattice model with only one type of 
particles. It can be recognized as simple two-state model since each site can either be occupied 
(infected) by a particle A or empty (healthy) 0. The reaction in the system is defined in 
terms of transition rates of two types: (i) an occupied site can infect its empty neighbours 
with a rate A, (ii) any infected sites may recover with a rate k decreasing the total amount 
of spreading agent. The competition of this two processes characterizes the behaviour of such 
spreading processes. Depending on the relative rates A = X/k which controls the balance 
between infection and recovery, the system can evolve into two final states. If A > A c the 
infection process dominates, the epidemic disease will spread over all the systems, reaching a 
stationary state in which the infection and recovery balance one another. However, if A < A c 
the recovery dominates and the total amount of spreading agents continues to decrease and 
eventually vanishes. Then the system is trapped to a completely inactive state, the so-called 
absorbing state. Since this absorbing phase can be reached but not be left, the system cannot 
satisfy the condition of detailed balance so it is driven by a non-equilibrium process. The 
transition between the stationary infected and absorbing phase is continuous and characterized 
by universal behaviour [169]. The simplest model exhibiting such transition is the directed 



case of percolation model (see Section 2.3.31 which denominate the related universality class of 
directed percolation (for a review see [170, 171]). 

In directed percolation an orientation is defined for each percolating edge of the lattice which 
determines the direction that the spreading agent can only move along (like water in porous 
medium in gravitation field) . A phase transition occurs for directed percolation which is similar 
in many respects to the transition of isotropic case. The two phases are defined by the exis- 
tence of an infinite percolating cluster and controlled by a probability p. It has a critical value 
p c when the percolating cluster appears and the order parameter like percolation probability 



becomes 0(p > p c ) > as we have discussed in Section 2.3.3 However here p c is larger than for 
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the isotropic case and the critical behavior is also different. Instead of having rotational invari- 
ant long-range correlation, duality symmetry and rational critical exponents, here the critical 
properties present anisotropy in space leading to different critical exponents. The numerical 
values of exponents are not known analytically but seem to be irrational numbers. 



5.2.1 The Contact Process 



The contact process is a lattice model belonging to the universality class of directed percola- 
tion, first introduced by Harris [172, 173] as an infection spreading model without immunization. 
It is defined on a graph, whose site can be either active (sj(t) = 1) or inactive (sj(t) = 0). During 
the time evolution we use a random sequential update and pick up a site i at each step randomly. 
At the next t + dt iteration step the state of the chosen site Si(d + dt) — 0, 1 depends on its 



previous state Si(t) at time t and the number of its active first neighbours rii(t) = ^2 



The new state is assigned according to certain transition rates R(.Si(t) 
are defined for the standard contact process as: 



(id) b i 



(*)• 



R(0 



= Xn/ki 

0, Hi) = K = 1 



i(t + dt),rii(t)) which 

(5.5) 
(5.6) 



where ki denotes the degree of the ith site (see Fig 5.1 1. We set the recovery probability k = 1 



so the infection probability A controls the spreading process. 
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Figure 5.1: Contact process on 1+1 dimensional lattice. The empty point at Si denote the inactive 
point which becomes infected by its active neighbours s;_i or Si+i with a rate A/2 per site. If Si is 
infected (fullfield point) then it recovers with a probability 1 in one time iteration [168]. 



We get the simplest representation of the model at 1 + 1 dimension, when the underlying 
graph is a chain. Then the critical point is located at A c = 3.29785(8) suggested by Monte 
Carlo simulations and series expansions [174-176]. The master equation of the 1+1 dimensional 
contact process with periodical boundary condition and size N can be written as [168]: 



N 



d t w t {si 



+\ s W t (si, S;_i, 0, 1, Sj +2 , S N ) 



-W t (si, ...,Si 



1, s 



i+lj 



, s N )} 



(5.7) 



where w t (si, sjy) denotes the probability that the system is in the configuration {s%, sjv} 
at time t. Here we involved only two-site interactions. Then the corresponding Liouville 
operator Ccp = J2i A is given by: 
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In higher dimensional lattice systems or in complex networks the master equation becomes as 
complicated as it is not solvable analytically. Then approximation methods become appropriate 
to describe the critical behavior of the model. A corresponding method arises from mean field 
theory what we will apply to give a dynamical solution of the contact process in scale-free 
networks. 



5.3 Dynamical mean field solution of contact process in 
scale-free networks 

In many cases the macroscopic properties of reaction-diffusion processes can be predicted 
by solving the corresponding mean field theory. If the system contains a large number of 
particles and the diffusion is dominating over the reaction then this solution gives a relevant 
approximation and becomes exact in infinite dimensions. Here we present a dynamical mean 
field solution of the contact process [168, 172] as a dynamical adaptation of the Weiss molecular 
field theory. We apply this model on a scale-free network with power-law degree distribution 
characterized by a degree exponent 7 as we defined in Section |3.3.3| This solution is expected 
to be exact, due to long-range interactions in the system. We initially assume that the infected 
agents are homogeneously distributed all over the network and ignore any spatial correlation 
as well as instabilities with respect to inhomogeneous perturbations. 

We start with a set of equations of the time derivative of the mean active site density, pi , at 
site, i = 1,2, ... ,N: 

3 

where the correlations between densities of different sites are omitted. Here A^j gives the 
strength of infection, the (1—pi) term is the probability that the zth site is empty and the pj gives 
the probability that the jth site is infected. The last — pt term represents the recovery in the 
equation. In the next step following the spirit of the Weiss molecular mean-field approximation 
we replace the interactions using Eq |5.1| 

_ kjkj (kjkj) ^ . . 

A " A V A; ; > ' ::, - ' ! 

i.e. there is an interaction between each site having the (mean) value, which is proportional to 
the probability of the existence of the current bond (P(kikj) — kikj/^2^ kj). Now in terms of 
an average density: 

„_^J k J " Pi 



(5.10) 



we can rewrite the dynamical equation as: 



■W = E V.fc. (fc -V £-Pi)Pi~Pi 

3 

jr 1 — (J, 

= Afc ^E E . fc V^) 2 (1 ~ Pi)Pj '~ Pi (5A2) 

Then we multiply the first term on the right hand side with y\ fcj / k x ~^ and rewrite the 
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equation of the form: 



dpi 

at 



= Xk 



1-/1 



= Xk 



1-/1 



E 

3 

E 



(l-Pi)^T 



■ 1 — U 



(i - pi)p- Pi 



(5.13) 
(5.14) 



where we used a substitution with p defined in Eq 5.10 If we multiply again the first term with 
N/N, we arrive to the form: 



dpi 
Bt 



k) ''Att^ — —(l-pi)p-pi 



(k)(k 



-M2 



(5.15) 



with A = X(k 1 -^)/(k)(k-' 1 ) 2 . 

In the stationary state, dpi/dt = 0, the local densities are given by: 



Pi 



1 + A^p 



(5.16) 



i.e. they are proportional to k\ fJ '. Putting pi from Eq 5.16 into Eq 5.10 we obtain an equation 
for p: 



o = 1 V fc i-M Afc j * p 



which can be rearranged as: 



T,kl-" = E fc i" M ~ i = A E *l 
i ^ ; l + Afc^p ^i + Xk^p 



(5.17) 



(5.18) 



Now if we take the continuous limit thus the summation over i is replaced by an integration over 
the degree distribution, Po(k), and choose the upper limit of the integration for k ma x — * oo 
(thermodynamic limit) then: 



(k 1 -^) = X 



1.2(1-/1) 

P D (k) — ^ dfc 



(5.19) 



The solution of Eq |5.19| in the vicinity of the transition point, />« 1, depends on the large- 
k limit of the degree distribution, defined in Eq |3.10| This solution is given in terms of the 
integration variable, k' — fc 1 ^, as: 



(k') = XA 



k r - 



1 + Xk'p 



dk' = Q(p,y), p«l, 



(5.20) 



where 7' was defined in Eq 5.2 Note, that the functional form of the Eq 5.20 is identical to 
that for standard scale-free networks, just with an effective degree exponent, 7'. 

To analyze the solution of Eq 5.20 we apply the method in [159], which is somewhat different 
from the original method in [177]. For small p, Q(p, 7') in Eq |5.20 can be expanded in a Taylor 
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series at least up to the term with ~ p 2 as: 

' k 'm... 

where the first three terms can be written of the form: 



Q{ P) <Y) = \A / k'-~<'k' 2 {l~\k'p+{\k'pf 



.)dk' 



ai(p) 



= XA 



k' 



fc'- 7 



kL 



-X 2 P A 
X 3 p 2 A 



kL 



1 + 

x fc'~ 7 ' 



"-^ — dfc' 
Xk'p 

fc' 3 
1 + Xk'p 

fc' 4 



p=0 

dfc' 



p=0 



1 + Xk'p 



dfc' 



(5.21) 

(5.22) 
(5.23) 
(5.24) 



p=0 



Following from these terms we can detect three range of 7' where the critical behavior is 
different: 

• 7' > 4 

The first term of the series expansion is (fc') = XA(k' 2 ) consequently there is a finite 
transition point, A c = (k')/A(k' 2 ), and the density in the vicinity of the transition point 
behaves as: p(X) ~ (A — A c ). This is the conventional mean-field regime since the degree 
exponent is larger than the upper critical value 7' > 7„(= 4) and the critical behavior on 
the scale-free network is the same as on a complete graph. At the borderline case, 7' = 4, 
there are logarithmic corrections to the mean-field singularities. 

• 3 < 7' < 4 

Here the effect of the connectivity of the scale-free network is relevant, so the singularities 
of the thermodynamical quantities of the system are different from the conventional mean 
field behavior. For small p only the linear term in the Taylor expansion of Q(p, 7') exists 
and the /^-dependence of the next term becomes singular. The critical behaviour in this 
regime is due the interplay between the regular linear first term (which exists since 7' > 3) 
and the negative singular next-to-leading term in the expansion. 

The p-dependence can be estimated by noting that for a small, but finite p there is a 
cut-off value, fc' ~ l/p, so that 



ai{p) 



-X 2 pA 



fc'- 7 'fc' 3 dfc' ~p 7 '- 



(5.25) 



Consequently the density at the transition point behaves anomalously, 

p~{X-X c f, /3=l/(Y-3). (5.26) 
This is the unconventional mean-field region where the critical behaviour depends on 7'. 
• 7' < 3 



In this case Q(p, 7) is divergent for small p. Its behavior can be estimated as in Eq 5.25 
leading to Q(p, 7') ~ A 7 ~ 2 p 1 ~ 3 . Consequently the system for any non-zero value of A is 
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in the active phase. As A goes to zero the density vanishes as: 

p(X) ~ A (7 '- 2)/(3 - 7 ' } . (5.27) 

Here at the border, 7' = 3, the system is still in the active phase, but the density is related 
to a small A as: |ln(pA)| ~ 1/A. 

Before we confront these analytical predictions with the results of numerical simulations we 
discuss the form of finite-size scaling in scale-free networks. 



5.4 Finite-size scaling for d > d c 

In a numerical calculation, such as in Monte Carlo (MC) simulations, one generally considers 
systems of finite extent and the properties of the critical singularities are often deduced via 
finite-size scaling. As we have seen in Section [2. 2. 4| it is known in the phenomenological theory 
of equilibrium critical phenomena that due to the finite size of the system, L, critical singularities 
are rounded and their position is shifted [178]. As it is elaborated for Euclidean lattices finite- 
size scaling theory has different forms below and above the so-called upper critical dimension, 
d c . For d < d c in the scaling regime the singularities are expected to depend on the ratio, 
L/£, where £ is the spatial correlation length in the infinite system [179]. This case has been 
discussed in Section |2.2.4| On the other hand for d > d c , when mean-field theory provides 
exact values of the critical exponents, following from renormalization group treatments, the 
finite-size scaling theory involves dangerous irrelevant scaling variables [180], which results in 
the breakdown of hyperscaling relations. For equilibrium critical phenomena predictions of 
finite-size scaling theory [181,182] above d c are checked numerically, but the agreement is still 
not satisfactory [183-185]. 

For non-equilibrium critical phenomena finite-size scaling above d c is considered first in the 
frame of scaling theory [186] and for the percolation process [187] and applied also for a cou- 
pled directed percolation system [188]. A field-theoretical derivation of the results has been 
made only very recently [167, 189] and here we recapitulate the main findings of the analy- 
sis. For directed percolation, which represents a broad class of universality [168], dangerous 
irrelevant scaling variables are identified in the fixed point. As a consequence scaling of the 
order-parameter is anomalous: 

p = L-M v 'p(6LV v ' , hL*' v *) , (5.28) 



Here, 5, is the reduced control parameter, with the notations of Section 5.3 6 = (A — A c )/A c 
and h is the strength of an ordering field. The critical exponents, (3=1 and A = 2, are the 
same as in conventional mean-field theory. However, the finite-size scaling exponent is given 
by, v* = 2/d, and thus depends on the spatial dimension, d. Note, that below d c = 4 it is the 



correlation length exponent, v, which enters into the scaling expression in Eq 5.28 but above 
d c , due to dangerous irrelevant scaling variables it should be replaced by v* . At the critical 
point, 6 = 0, the scaling function, p(0,x), has been analytically calculated and checked by 
numerical calculations. 

In the following we translate the previous results for complex network, in which finite-size 
scaling is naturally related to the volume of the network via the relation N <-> L d , where TV is 
the number of sites. We examine two different cases in the conventional mean-field regime with 
respect to a site with average or maximum degree. For a typically connected site, i.e. with a 
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coordination number , k ~ (k), we arrive from Eq 5.28 to the finite-size scaling prediction: 

Pty P = N-P^ptypiSN 1 / 2 , hN A / 2 ) , (5.29) 
where u> is defined as the correlation volume critical exponent u> = dv* . On the o ther hand for 



the maximally connected site with k 
scaling form is modified by: 



ATV(7-i) j 100 ] accorc ji n g to Eq. 
Pmax = N-U^-Mb-Vp^iSN^thN**) 



5.16 



the finite-size 



(5.30) 



Since in the derivation of the relation in Eq|5.28|the actual value of (3 has not been used, we 



conjecture that the results in Eqs 5.29 and |5.30| remain valid in the unconventional mean-field 
region, too. The suggestions above expected to hold for scale-free networks, however those 
cannot be exact even in the conventional mean-field regime since the system size is finite. 



5.5 Monte Carlo simulation 

Next we are going to review some algorithmic methods and results of Monte Carlo simulations 
in order to study numerically the previously presented theoretical predictions. First we repre- 
sent the contact process in an algorithmic manner, then we describe our results of numerical 
simulations about its critical behaviour and confront it with the theory. 

5.5.1 Implementation of Contact Process 

As we have seen before the contact process is a lattice model which is governed by two pro- 
cesses, the infection what is spreading site-to-site and the recovery which retard the infestation 
during the dynamic. Following this property the related algorithm can be decomposed in two 
independent parts in one time step, which gives a possibility to parallelize the algorithm. 

As a first step we read the network, calculate the weight degradations X^j for each edge as 
it was defined in 5.1 and choose an initial site to infect (see Alg{7]). During the method we 



contain the sick nodes in a list InfectedList() that we update at every iteration. At each time 
step we check all the nodes i in InfectedList() and try to infect their neighbours j with a rate 
Xij. The newly infected sites are stored in a separated list NewInfectedList(). At the same 
time step we recover all the occupied nodes in InfectedList() with a rate k and delete them from 
the list if they become healthy again. Finally we merge the NewInfectedList() and the rest of 
InfectedListf) to produce the new set of infected nodes for the next time step. 

The running time of the algorithm can be approximate with the function f(N) ~ t(N(k)+N) 
which is strongly influenced by system properties like the degree distribution. During our 
calculation we applied the process on scale-free networks with average degree (k) ~ 1 but we 
let the system running for t ~ 27V time steps, consequently the execution time was 0(4iV 2 ). 

5.5.2 Numerical results 

In the actual calculation we considered the contact process on the Barabasi- Albert scale-free 
network [15], which has a degree exponent, 7 = 3, and used a degradation exponent, fi — 1/2. 



Consequently from Eq 5.2 the effective degree exponent is 7' = 5, thus conventional mean-field 
behavior is expected to hold. (We note that the same system is used to study the equilibrium 
phase transition of the Ising model in Ref. [166].) Networks of sites up to TV = 4096 are 
generated using the Alg|6]by starting with mo = 1 node and having an average degree: (k) = 2. 
Results are averaged over typically 10000 independent realizations of the networks. 
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Algorithm 7 ContactProcessQ 
1: Initialization 

2: Choose an initial point and infect it 
3: for all timestep t do 
4: for all nodes i in InfectedListQ do 
5: for all neighbours j of i do 
6: if Infection ( Ai j then 

7: NewInfectedList. insert (j) 

8: end if 

9: end for 
10: end for 

li: for all nodes i in InfectedListQ do 
12: if Recover(/t,i) then 
13: InfectedList. delete (i) 

14: end if 
15: end for 

16: InfectedListQ <= Merge(InfectedList(),NewInfectedList()) 
17: end for 



In the calculation we started with a single particle at site i, (which was either a typical site 
or the maximally connected site) and let the process evolve until a stationary state is reached 
in which averages become time independent. In a finite system in particular in the vicinity 
of the critical point this state is only quasi-stationary and has a finite life-time before in the 
system all particles are annihilated. In order to obtain a true (quasi-) stationary average value 
we have considered only the samples which have survived up to the time where the average 
is done [190]. In the calculation we monitored the average value of the occupation number, 



pi, as introduced in mean-field theory in Eq 5.8 and the fraction of occupied sites, m,, (order 



parameter) as a function of the control parameter A = A/k, whereas k = 1 was set to be 
unity. In a regular lattice in the stationary state and in the thermodynamic limit pi and mi are 
the same quantities. In a complex network, however, in which the pi are position dependent 
they are not strictly equivalent. Their singular behavior in the vicinity of the transition point, 
however, is expected to be the same. Indeed at the critical point the fraction of active sites is 
vanishing with N, sec in Eqs |5.29| and |5.30"| therefore starting from a typical site the probability 
of the infection of a largely connected site is vanishing. 

5.5.3 The A c phase transition point and x finite-size scaling exponent 



The A dependence of the order parameter is shown in Fig 5.2 for a typical site and in Fig |5.3| 
for the maximally connected site. Evidently there is a phase transition in the system in the 
thermodynamic limit between the absorbing state and a stationary infected state, which is 
rounded by finite size effects as shown in the insets of Figs. |5.2| and |5.3| 

As we have seen in Eq |2.24| the order parameter at the vicinity of the critical point of con- 
tinuous phase transitions is scaling as a power law which arises of the form following from |5.4| 
as: 

m(t, N) ~ N- x m{N 1/u t) (5.31) 



where x — j3/u> — (3/dv* denotes the finite-size exponent as given in scaling theory in Eqs 5.29 



and 5.30 At the critical point the magnetization can be written as m(N, t = 0) ~ AN x where 



A is a constant. Consequently the ration of magnetization of the systems with size TV and N/2 
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Figure 5.2: Variation of the order parameter at a typical site as a function of the creation rate, A. 
Inset: Enlargement in the critical region. 



can be written in the form: 

_ m (t = 0,N) N~* 
r[IV ~ m(t = 0,N/2) ~ (N/2)- ~ 2 (5 ' d2j 

where the order parameter curves for different TV cross each other and the crossing point can 
be used to identify A c and exponent x through extrapolation. To locate the phase transition 
point we form this ratios for different finite sizes. As shown in Fig |5.4| r(N) tends to zero in 
the inactive phase, A < A c , and tends to a value of one in the active phase, A > A c . 




Figure 5.3: As in Fig 5.2 for the maximally connected site. 



The transition point is found to be the same within the error of the calculation both for a 
typical site and for the maximally connected site and given by: A c = 2.30(1). The finite-size 
scaling exponent, however, calculated from r(N,\ c ) is different in the two cases. For a typical 
site we estimate: Xt yp = 0.54(7), which should be compared with the field-theoretical prediction 
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in Eq 5.29 which is x typ =/3/2 = l/2. In the maximally connected site the finite-size scaling 
exponent is measured as x max = 0.27(4), which again agrees well with the field-theoretical 
prediction in EqlpO] x max = (3/2 - (1 - /x)/(7 - 1) = 0/2 - 1/(V - 1) = V 4 - 




Figure 5.4: The ratio r(N) = m(N)/m(N/2) a) for a typical site, b) for the maximally connected site. 
Note that the location of the crossing points, which defines A c is the same in the two cases, whereas the 
value at crossing, which is related to the finite-size exponent, x, through r(N, A c ) = 2~ x is different. 



5.5.4 The lu correlation volume exponent 



Next, we consider correlations in the vicinity of the transition point and calculate the relation 
between the correlated volume V ~ £ d , and the distance from the critical point, 6. Following 



the consideration in Eq 2.14 it is expected that the correlation volume arises in a power-law 
form, V ~ |<5| _a ', where oj — dv* is the correlation volume exponent (see Eq, 5.291. According 
to field-theoretical results in Eqs |5.29 and |5.30| this exponent is u> — 2 in the mean field regime 
since there v* = 2/d (see Section |5T4 ) , both at a typical site and at the maximally connected 
site. Now in the limiting case, V ~ N, the scaled orde r parameter, rh — mN x , is ex pect ed to 
depend on the scaling combination, N^-^S (see Eq 5.31 1, which is demonstrated in Fig 5.5 both 
in the typical site and in the maximally connected site (inset). In both and A c are fixed 

by the previous analysis and uj is obtained from the optimal scaling collapse, as Lo typ = 2.1(2) 



and w„ 



2.0(1). Thus, once more we have agreement with the field-theoretical results. 



5.5.5 Dynamical scaling 

Finally, we turn to analyze dynamical scaling in the system. At the critical point, A = A c 
we have measured the number of active sites, N a , as a function of time, t, which is shown in 



Fig 5.6 when the starting point is a typical site and in Fig |5.7| for the maximally connected 
site. As seen in Figs 5.6 and 5.7 after a starting period (which is discussed below) there is an 
asymptotic region with a power-law dependence, N a ~ t a , which turns to a saturation regime 
around t ~ iV\ when the active sites reach the boundary of the system. 

Here the networks were generated with a parameter mo = m = 1 (Alg. [T]) thus the initial 
network was always a single node and during the network evaluation. At each iteration step 
we added new a site with m = 1 number of edge, consequently the generated graph became a 
tree which boundary could be defined as the set of nodes with degree k = 1. The sites of this 
boundary set are those which were added later to the network and which are less connected. 

At the critical point, when the infection is initiated from a single site, the disease spreads 
all over the system until the infection becomes homogeneously distributed all over the network. 
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N 1/(0 S 



Figure 5.5: Scaling collapse of the order-parameter near the transition point using the functional forms 
in Eq 5.29 for a typical site and in Eq 5.30 for the maximally connected site (inset). The finite-size 
scaling exponents, x typ and x max are fixed by the previous analysis and the correlation exponent, ui, is 
used to have an optimal collapse of the data, see text. 



It means that the infection reached all the boundary sites, the correlation length became com- 
mensurable to the diameter of the network and the correlation volume turned to be V ~ N. 
Following this limiting point the system arrives to its saturation region, where the infection eval- 
uates homogeneously in the whole graph and the number of infected sites fluctuating around a 
finite value. 



It is seen in Figs 5.6 and 5.7 that the exponents at yp and a max , which refer to a typical 
site and the maximally connected site, respectively, are different. However the border of the 
saturation regions, i.e. the exponent £ are approximately the same for the two cases. In a regular 
lattice with dimension, d > d Cl (which contains only typical sites) the dynamical exponent, 
is conjectured [186] to be, £ = 1/2, which is derived recently by field-theoretical methods [167] 
and checked numerically [189, 191]. This result for £ is expected to hold for networks, too. 



In order to analyze the results in Figs 5.6 and 5.7 we discuss the scaling behavior of N a (t, N). 



In the stationary state the density is independent of the initial conditions and it is proportional 
to the density at a typical site, pt yp ~ N~ Xtyp . Since p ~ N a /N therefore the scaling form of 
the active site number is given by: 

N a (t, N) = N^^Nait/N^) , (5.33) 

in which the scaling function, N a (y), is different for a typical site and for the maximally con- 
nected site, respectively. In the small y limit before the saturation time, we obtain N a (y) ~ y CH yp 
and N a (y) ~ y a ™ a * , for a typical site and for the maximally connected site, respectively in this 
way we recover the previously announced t-dependences. For small t, N a is of 0(1) relational 
the average number of first neighbours, if we start with a particle at a typical site. 

Next we analyze the size dependence of N a (t, N) at a fixed t. For a typical site Zzmjv-Kx>^Va(i, N) 
is expected to have a finite limiting value, which is in accordance with the numerical results in 



Fig 5.6 Indeed for typical sites the size of the network should not influence the local growth in 
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Figure 5.6: Time dependence of the number of active sites starting from a typical site at the critical 
point in a log- log scale. For t > iV , when the infection has reached the border of the system the curves 
are saturated. The slope of the limiting curve for N — > oo defines CHyv The full straight line with 
slope 0.84 fits the largest finite-size data. For small sizes there is a cross-over and the local slope of the 
curves is a max ~ 0.5, see text. Here the broken straight line has a slope of 1/2. Extrapolation of the 
finite-size slopes, a typ (N), as a function of 1/ In N is shown in the inset. 



the system. Using the small y behavior of the scaling function we obtain the form: 

N a (t, N) ~ jV 1_ ^(t/iV Ct «>) a *«' (5.34) 
where for small t, N a ~ 1 and we obtain the relation at a fixed t: 

1 %typ Ctyp a typ = . (5.35) 

For not too large finite systems, however, there is a starting regime and thus a cross-over 
phenomenon what can be seen in Fig |5.6| This cross-over is due to the fact that in a small 
system the infection can reach the maximally connected site in a short time and afterwards the 
growth is characterized with an exponent a max < at yp - This starting region is also indicated in 
Fig(^6] 

If we proceed from the maximally connected site, for small t, N a has the same order as the 
number of links at the hub. However the number of neighbors and thus the local density depend 
on the size of the network. As a consequence N a (t, N) at a fixed t has a size dependence, which 



can be seen in Fig 5.7 Using the result in Eq5.16 we obtain lim/v_>oo N a (t, N) ~ k^J^. 
iV( 1 -^)/(7-i) _ ni/Vy-i) ^ N x typ - Xma ^ where we uged the approximation k max - iV 1 /(7-i) 

which is true for scale-free networks with degree exponent 7 [100]. Now comparing the N 
dependence for small t leads to the equation: 

N x typ -x max ^ N i-x ty p( t / N C m a*)a m a* ( 5 36 ) 

which leads the relation at a fixed t: 

1 %typ Cmax^max ^typ ^rnax • (5.37) 

The exponent, at yp , can be obtained from the asymptotic slope of the master curve in Fig|5.6| 
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which has a strong size dependence. Extrapolation as shown in the inset of Fig |5.6| gives 
o-typ = 0.95(10) which is compatible with the mean field and finite-size scaling prediction, 
O'typ — 1 derived from Eq 5.35 



For the maximally connected site in Fig |5.7| the slope of the curves have a weaker size- 
dependence and can be estimated as: a max — 0.52(4). Consequently from the relations in 
Eqs 5.35 and 5.37 we obtain that both C,typ and Cmax ar e compatible with the mean field 



prediction, £ 1/2. The scaling p redi ction for N a (t, N) for small t is checked for the maximally 
connected site in the inset of Fig 5.7 Here N a /N c is plotted as a function of t/N*>. There is 
an appropriate scaling collapse with the expected values: c = 1 — xt yp = 0.5 and Cmax = 0.5 
derived from Eq |5.35| and |5.37[ After the infection reached its saturation value, we get back the 
mean-field value a = [171] in both cases since the active sites are homogeneously distributed 
all over the network and the their number is fluctuating around a constant value. 

From the previous results, using N ~ 5~ u , we obtain for the scaling behavior of the relaxation 
time t (defined in Eq 2.361, in the vicinity of the transition point, r ~ 5~ u u , with vu = Qu, 
so that v\\ = 0.95(10) both for the typical and the maximally connected sites, in complete 
agreement with the mean field and finite-size scaling result, i/u = 1 [191]. 



5.6 Summary 

In this section we considered non-equilibrium phase transitions in weighted scale-free net- 
works, in which the creation rate of particles at given sites is rescaled with a power of the 
connectivity number. In this way non-equilibrium phase transitions are realized even in realis- 
tic networks having a degree exponent, 7 < 3. Mean field theory, which is generally believed 
to be exact in these lattices, is solved and the previously known three regimes of criticality 
(conventional and unconventional mean-field behavior, as well as only active phase) are iden- 
tified. The theoretical predictions in the conventional mean-field regime are confronted with 
the results of Monte Carlo simulations of the contact process on the weighted Barabasi- Albert 
network. 

To analyze the simulation results we have applied and generalized recent field-theoretical 
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considerations [167] about finite-size scaling of non-equilibrium phase transitions above the 
upper critical dimension d c = 4, i.e. in the mean-field regime. For a network the natural 
variable is the volume N (mass) of the system which enters in a simple way into the scaling 
combinations. 

We investigated two different cases, when the contact process was started from a site with 
average degree or the infection spreading was initialized from the best connected site with the 
maximum degree. In the first case we have obtained overall agreement with finite-size scaling 
theory in which the critical exponents are simple rational numbers. We have also numerically 
demonstrated that at sites with very large connectivity there are new local scaling exponents, 
which differ from the values measured at a typical site. 

As an extension of our results we could check the change of critical behaviour as the system 
approaches the border of the conventional mean-field regime. To do that we could perform a 
similar study using different degradation exponent leading to the borderline value 7' = 4. 

Some parts of this chapter were based on a recent paper which contains also all the previously 
discussed results. It was published in a frequented journal of the field by Marton Karsai, Robert 
Juhasz and Ferenc Igloi in the Physical Review E 73 036116 in 2006 [23]. 
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Chapter 6 

Rounding of first-order phase 
transitions and optimal 
cooperation in scale-free 
networks 



6.1 Introduction 

Cooperative behaviour in real systems appears when entities get more advantage from col- 
lective acts than going ahead alone. This phenomena depends on the interaction between the 
agents and external conditions also. A few examples come from sociology where the entities are 
humans and the external condition can be defined as a political status, or in economy where 
the interactions are defined between firms with external subsidy, etc. It is straight forward if 
one participant earns more alone then collective morals are reduced, individual acts become 
likely and the entities are uncorrelated. However, if the agents cannot prefer a claim lonely 
then cooperative behaviour becomes favorable and a correlated phase appears. Such kind of 
cooperative phenomena arise in many parts of physics also. The most obvious example is 
the appearance of magnetic domains in ferromagnets. In this chapter we examine such kind 
of cooperative model in scale-free networks. Here we investigate a simple magnetic model in 
which the agents are represented by classical spin variables: the interactions are described by 
ferromagnetic couplings, whereas the temperature plays the external role of a disordering field. 

An equivalent statistical model to simulate optimal cooperation in physics is the ferromagnetic 



random bond Potts model at q — > oo limit. As we mentioned in Section 2.3.1 the phase 
transition of this model in regular lattices with homogeneous couplings Jij = J is of first order. 
However, in theoretical investigations of cooperative behavior one is usually interested in the 
influence of disorder on collective phenomena. Putting this model on a complex network, the 
inhomogeneities of the lattice play the role of some kind of disorder and it is expected that 
the value of the latent heat is reduced or even the transition is smoothened to a continuous 
one. This type of scenario is indeed found in a mean field treatment [159], in which the phase 
transition depends on the scale-free degree exponent 7 as we have discussed in Section |5.1| It 



is of first-order for 7 > j(q) and becomes continuous at the unconventional mean field regime 



for 7 C < 7 < 7(g), where 3 < 7(g) < 4 and j c — 3 (see Fig 6.1 1. On the other hand in an 



effective medium Bethc lattice approach, such a study leads to the fact that the phase transition 
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of the g-state Potts model is of first order if q > 3 and the second moment of degrees (k 2 ) is 
finite. For scale-free networks it is true only if 7 > 3. Consequently 7(g) = 7 C = 3, thus the 
unconventional mean-field regime is absent in this treatment [160]. 




Figure 6.1: Regions of first- and second- 
order phase transitions for the g-state 
Potts model on scale-free network with 
a degree exponent 7. In the second-order 



regime, i.e., below the upper critical value 
j gamma u the singularities are 7 depen- 

2 4 6 8 10 q dent I 159 ]- 



Another way to introduce disorder into the system is through the strength of interactions. The 
interactions were considered homogeneous so far, however, in realistic situations the disorder is 
inevitable, and has a strong influence on the nature of the phase transition. As we have discussed 
in Section [2. 4.1 1 in regular lattices for a second-order transition Harris-type relevance-irrelevance 
criterion (see Eq 2.671 can be used to decide about the stability of the pure system's fixed point 
in the presence of weak disorder. On the contrary for a first-order transition such type of 
criterion does not exist. In this case rigorous results assert that in two dimensions for any type 
of continuous disorder the originally first order transition softens into a second order one [77] . 
In three dimensions there are numerical investigations which have shown [74, 78-80, 192, 193] 
that this kind of softening takes place only for sufficiently strong disorder. 

In this chapter we consider interacting models with random interactions on complex networks 
and in this way we study the combined effect of network topology and bond disorder. The par- 
ticular model we consider is the random bond ferromagnetic Potts model for large value of q 
what we have defined in Section |2. 3. 5| This model besides its relevance in ordering-disordering 
phenomena and phase transitions has an exact relation with an optimal cooperation problem 
(see Section 4.3 and [20,21]). This optimization problem can be interpreted in terms of coop- 
erating agents which try to maximize the total sum of benefits received for pair cooperations 
plus a unit support which is paid for each independent projects. For a given realization of the 
interactions the optimal state is calculated exactly by a combinatorial optimization algorithm 
which works in strongly polynomial time. The optimal graph of this problem consists of con- 
nected components (representing sets of cooperating agents) and isolated sites. The topology 
of the optimal set which is temperature (support) dependent contains information about the 
collective behavior of the agents. In the thermodynamic limit one expects to have a phase 
transition in the system, which separates the ordered (cooperating) phase with a giant clusters 
from a disordered (non-cooperating) phase, having only clusters of finite extent. 

The structure of the chapter is the following. The model with the applied random edge 



degradation is presented in Section 6.2 The solution for homogeneous non-random evolving 
networks can be found in Section 6.3 whereas numerical study of the random model on the 
Barabasi- Albert network is presented in Section |th4| Our conclusions are summarized in Section 
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6.2 The Random Bond Potts model 

The random bond Potts model is a special case of the general g-state Potts model what we 
have discussed in details earlier in Section 12.3.11 and 12.4.21 In the absence of external field this 
model is defined by the Hamiltonian: 

H = -^2j iJ S{a i ,a j ) (6.1) 

(m) 

where <jj = 0, l...q— 1 are the Potts-spin variables. As we explained in Section [233] in the limit 



q — > oo the partition function can be written in a random cluster representation (see Eq 2.62 ) in 
terms of its subgraphs, which is dominated by the largest term. This so-called optimal set 4>*{G) 
is proportional to the free-energy per site of the system and can be recognized as a submodular 
function. This property gives the possibility to calculate the optimal set in strongly polynomial 
time using combinatorial optimization. This method and the related iterational algorithm were 
discussed in details in the previous Section [473] 

In our case the couplings, J i:; - > 0, are ferromagnetic and they are either equal, J. L j = J, 
which defines a homogeneous networks, or they are identically and independently distributed 
random variables. Here we use a quasi-continuous distribution: 



, , , . 2z I 1 . 
./ ( 1 + A ) - ./, 



(6.2) 



which consists of large number of I equally spaced discrete values within the range J(l ± A/2). 
Here < A < 2 measures the strength of disorder. 

Following from earlier calculations on two and three dimensional regular lattices [72-74,80], 
the optimal graph at low temperatures is compact and the largest connected subgraph contains 
a finite fraction of the sites, m(T), which is identified by the order parameter of the system. 
In the other limit, for high temperatures, most of the sites in the optimal set are isolated and 
the connected clusters have a finite extent. Their typical size is used to define the correlation 
length, £. Between the two phases there is a sharp phase transition in the thermodynamic limit. 
Its order depends on the dimension of the lattice and the strength of disorder, A. 

As already mentioned in the introduction this optimization can be recognized as an optimal 
cooperation problem in which the agents, which cooperate with each other in some projects, 
form connected components. Each cooperating pair receives a benefit represented by the weight 
of the connecting edge (which is proportional to the inverse temperature) and also there is a 
unit support to each component, i.e. for each projects. Thus by uniting two projects the 
support will be reduced but at the same time the edge benefits will be enhanced. Finally one 
is interested in the optimal form of cooperation when the total value of the project grants is 
maximal. 

In the following section we solute exactly this optimization problem for evolving networks 
with homogeneous interaction, when A = and each pair of spins receive the same amount of 
profit. 



6.3 Exact solution for homogeneous evolving networks 

In regular d-dimcnsional lattices the solution of the optimization problem is simple as we 
presented in Section |2.3.5| There are only two distinct optimal sets, which correspond to the 
T = and T — > oo solutions, respectively. In the proof we make use of the fact, that any edge 
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of a regular lattice, ei, can be transformed to any another edge, e2, through operations of the 
automorphy group of the lattice. Thus if ei belongs to some optimal set, then e2 belongs to 
an optimal set, too. Furthermore, due to submodularity the union of optimal sets is also an 
optimal set, from which follows that at any temperature the optimal set is either or E. By 
equating the free energies of the two phases we obtain the position of the transition point as: 
Tc°^ — Jd/(1 — 1/iV) whereas the latent heat is maximal: Ae/T^ - 1 = 1 — l/N. (The supe rscri pt 
in Tc°^ is related to the non-random system, i.e. when the strength of disorder in Eq 



6.2 



A = 0.) 

In the following we consider the optimization problem in homogeneous evolving networks 
which are generated by the following rules: we start with a complete graph with 2/i vertices 
and at each timestep we add a new vertex which is connected to /i existing vertices. In definition 
of these networks there is no restriction in which way the fi existing vertices are selected. These 



could be chosen randomly, as in the Erdos-Renyi model (see Section 3.3.1), or one can follow 



some defined rule, like the preferential attachment in the Barabasi-Albert network (Section 



3.3.31. In the following we make some theoretical consideration to show that for such networks 
the phase-transition point is located at = J/i and for T < (T > T^) the optimal set 
is the fully connected diagram (empty diagram), as for the regular lattices. Furthermore, the 
latent heat is maximal: Ae/T^ 1 



In the proof we follow the optimal cooperation algorithm (Algj3| outlined in Section 4.3 



and in application of the algorithm we add the vertices one by one in the same order as in the 
construction of the network. We use a mathematical induction in our demonstration as follows: 

I. First we note, that the statement is true for the initial graph, which is a complete graph. 
Consequently it is regular. Thus the optimal set following from Eq |2.65| can be of two 
kind: 

• If T < T c , it is fully connected, and has a free-energy: — /32/i/ = 1 + /i(2/i — 1)/3J 

• If T > T c then the optimal set is empty and the free-energy is: —f32fif = 2fi 

thus the transition point is at — J [i which is calculated at the phase coexistence point 
where 1 + fi(2fi - X)j3J = 2/j,. 

II. Then we suppose that this property is satisfied after n steps and add a new vertex, Vq. 
Here we utilize an important point of the optimization method, defined in Section |4.3.2| 
Due to the submodularity of —<j>{G) each connected component in the optimal set are 
contracted into a new vertex in the network with effective edge weights being the sum of 
individual weights in the original representation. Then to discuss the behaviour of the 
optimal set, we investigate the two cases, T < and T > separately again: 

• If T < T c (0) , then according to our statement all the edges, which were included in 
earlier steps, are in the optimal set and all vertices of the original graph are contracted 
into a single vertex, s, which has an effective weight 

(jt x J jT > fiJ/T^ = 1 (6.3) 

to the new vertex vq. Following the method and using the capacities, defined in 
Eq 4.18j|4.20 it is straight forward that in the optimal set s and vq are connected. 



Consequently the newly added /i number of edges proceeding from Vo are in the 
optimal set also and the graph remains connected. 
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• If T > Tc , then all vertices of the original graph are disconnected, which means that 
for any subgraph, S, having n s < n vertices and e s edges one has: n s > e s JT + 1. 
This provides e s (T) < 1 and becomes equal only at the phase coexistence point Tc°^ 
where the first edge appears and the graph above becomes fully connected as we 
mentioned in the previous point. 

Then we add the new vertex vq with fi edges. Let us denote by fj, s < \x the number 
of edges between vo and the vertices of S. One has 

Li s x J/T < fix J/T < nJ/Tf> = 1 (6.4) 

so that for the composite S+vq we have: n s + l > e s JT+l+[j, s J/T, which proves that 
the vertex vq will not be connected to any subset S and thus will not be contracted 
to any vertex. 

This result, i.e. a maximally first-order transition of the large-g state Potts model holds for a 
wide class of evolving networks, which satisfies the construction rules presented above. This is 
true, among others, for randomly selected sites, for the Barabasi-Albert evolving network which 
has a degree exponent 7 = 3 and for several generalizations of the Barabasi-Albert network [16] 
including nonlinear preferential attachment, initial attractiveness, etc. In these latter network 
models the degree exponent can vary in a range of 2 < 7 < 00. It is interesting to note that for 
uncorrelated random networks with a given degree distribution the g-state Potts model is in 
the ordered phase [159, 160] for any 7 < 3. This is in contrast with evolving networks in which 
correlations in the network sites result in the existence of a disordered phase for T > tJ ' , at 
least for large q. 



6.4 Effective calculation of free energy 

To locate the critical point of the random bond Potts model and calculate the critical prop- 
erties of the system we need to determine some thermodynamical quantities as a function of 
the temperature T. We can do it iteratively but by exploiting some special features of the free 
energy we can find a more efficient and precise method that will be the subject of the first part 
of this section. Following that we then discuss some numerical results of the critical behaviour 
of the q — ► 00 random bond Potts model applied on scale-free networks. 



The free energy of the Potts model at q — > 00 limit can be recognized as a submodular 
function of the form Eq |2.65| which depends on the number of connected components and the 
sum of edge weights included in the optimal set. As we have shown for homogeneous systems 
in regular lattices and even in evolving networks, the system has a strictly first order phase 
transition between the fully connected and the empty graph. The critical point is located at 
the temperature where the free energy density, which is a linear function of T, has a breaking 
point (see Fig 2.4 1. 

When we define interactions with random capacities, the phase transition between the fully 
connected and the empty states is modified. A qualitative explanation holds in the fact that 
the edges with different capacities are excluded continuously from the optimal set as the tem- 
perature is varied and not all at the same T as for the homogeneous case. Consequently there is 
no phase coexistence between the two states and the phase transition softens into a continuous 
one. At the thermodynamical limit N — > 00 with continuous edge weight distributions, the free 
energy changes smoothly. However this is not true at finite size systems with quasi-continuous 



74 



ROUNDING OF FIRST-ORDER PHASE TRANSITIONS AND OPTIMAL COOPERATION IN 

SCALE-FREE NETWORKS 



distributions, where the average free energy functions, calculated over different random realiza- 
tions has only physical relevance. 

In finite systems the free energy is a piecewise constant function of the temperature, with 
monotonously increasing slope versus the temperature. For a given optimal set G\ it is: 



Pf(G' 1 ,f3)=c(G' 1 )+p J2 J k 



(6.5) 



where the slope of the related straight line is defined as the sum of the weights Yli jeG' m 
the optimal set, and the dislocation is equal to the number of connected components c(G'). 
When some edges leave the optimal set, then the free energy has a breaking point. It then fits 
on a new line 

(6.6) 



(3f(G' 2 ,[3) = c(G' 2 ) + f3 J k 



i,j€G' 2 



related to the new optimal set G' 2 . The breaking point is located at the temperature where 
f(G[,P*) = f(G' 2 ,/3*), which can be calculated as the intersection of the two straight lines: 



c(G;) - c(G" 2 ) 



(6.7) 



The magnitude of the integer members involved in this calculation increases with the system 
size and (5* becomes a ratio of two large numbers. For homogeneous systems when f3* — 
N/N e — 1/N e , the deviation is given by the second term which is inversely proportional to the 
number of edges N e . For continuous phase transitions where there are more breaking points, it 
indicates the same trend following from numerical calculations. 




m(T) 



mCTj) 




b) 



















X-ight %. 



Figure 6.2: Demonstration of free energy calculation of the q — oo random bond Potts model, (a) 
For a finite system the free energy is a piecewise linear function of the inverse temperature /3. It is 
joined by straight lines with breaking points at different [3. (b) The first derivative of the free energy is 
the system magnetization, which has a steplike behaviour with jumps at the same temperature as the 
free energy breaking points. The continuous magnetization can be realized over averages of different 
realizations only. 



To calculate the free energy for a given realization at a given temperature, calculation have 
strongly polynomial running time as we discussed in Section |4.3.3| The simplest method to 
calculate it for a temperature range, is to scan it with a given discretization frequency. The main 
problem with this process is that even if we can estimate the execution time, it is not sure that 
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we find all the breaking points and the precision is limited by the resolution of discretization. 

Another, more efficient method, can be defined as using the linear behaviour of the free energy, 
and calculate all its breaking points which fully specify the free energy curve also. This algorithm 
recursively calculates the intersections of straight lines, which are fitted to the free energy curve 
at certain temperatures, until it detects all the breaking points. To initialize the algorithm we 
need to calculate the free energy at three temperatures: at the two initial temperatures ft and 
ft (see Fig |6.2| and at the temperature ft related to the intersection of the two associated 
lines /(ft) and /(ft). Then we call the RecursiveFreeEnergy{f{f3\),f{j32)J{(3z)) algorithm 
defined in Alg|8] 



Algorithm 8 RecursiveFreeEnergy(/(ft),/(ft),/(ft)) 



1 


I3i ef t <= Intersection(/(ft),/(ft)) 


2 


f(Pieft) <= OptimalCooperation(ft e / t ) 


3 


if (/(ft e/t ) = /(ft) OR /(Ae/t) = /(ft)) then 


4 


Pieft is a breaking point! 


5 


else 


6 


RecursiveFreeEnergy ( /(ft ) ,/(ft e /t) J {Pi) ) 


7 


end if 


8 
9 


bright <= Intersection(/(ft),/(ft)) 


10 


fWright) <= OptimalCooperation(ftj 9ftt ) 


11 


if {f bright) = /(ft) OR ftfrigu) = /(&)) then 


12 


bright is a breaking point! 


13 


else 


14 


RecursiveFreeEnergy ( /(ft ) J (bright ) ,/(/%)) 


15 


end if 


16 


return 



At the first line of the algorithm we calculate the fte/t temperature as the intersection of 



the first two free energies given in the parameter list, using the Eq 6.7 To calculate the free 



energy /(ft e /t) we apply the OptimalCooperation() method, introduced in Alg{3] If the free 
energy at the crossing temperature ft e /t is equal to the free energy at ft or ft then we find 
an exact breaking point of the original free energy curve. If it is not true, an inner optimal set 
exists with free energy /(ft) < /(ft e /t) < /(ft) related to a line with an inner slope. Thus we 
call again recursively the function RecursiveFreeEnergy(f(f32),f((3ieft)),f(P2)) with the free 
energy at ft , ft e /t and ft . To complete the calculation we need to repeat the same method 
symmetrically for the right hand side intersection f3 r ight also. 

After the recursion terminated the algorithm gives back all the exact breaking point of the 
free energy in a given temperature range with an estimated error discussed above. The proof 
of the method is straightforward and evidently follows from the monotonia behavior of the free 
energy function. 

To calculate the execution time we need to estimate the number of breaking points n^. We 
have found experimentally that in all cases the number of breaking points is polynomial with the 
size of the lattice. The number of times we call the function OptimalC ooperation(f3) depends 
also on nb r as n ca u = 2(nb r + 1) — 1 thus the number of unuseful calls which are not related to 
any breaking points is n^. + 1. Consequently the execution time is polynomial in the number 
of breaking points so finding the exact free energy at all temperature is a polynomial function 
of the system size. 

Since the temperature ft of a breaking point (defined in Eq 6.7) is a rational number, it is 
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possible to calculate its value hypothetically with an arbitrary precision if the counter and the 
denominator are sufficiently large numbers. We realized this case using the GNU Multiple Pre- 
cision Arithmetic Library (GMP®) in a C++ environment, which is eligible to define arbitrary 
precise numbers limited only by the available computer memory. This implementation needs 
high performance, but it is useful for precise - few point - calculations of a system with large size 
and (or) capacities. However, during average calculations we chose lower precisions where the 
standard variable types were adaptable. In the following section we are going to review these 
numerical results, which were calculated using the above defined method on Barabasi-Albert 
scale-free networks. 



6.5 Numerical study of random Barabasi-Albert networks 

In this section we study the large-g state Potts model in the Barabasi-Albert network. To 
generate scale-free networks we used Alg|6]with preferential attachment. The value of initial 
connectivity was [i = 2 (in Alg|6]/i = m), and the network size was varied between N = 2 6 and 
N = 2 12 . The interactions are independent random variables taken from the quasi-continuous 
distribution in Eq |6.2| having I = 1024 discrete peaks and we fix J = 1. The advantage of using 
quasi-continuous distributions is that in this way we avoid extra, non-physical singularities, 
which could appear for discrete (e.q. bimodal) distributions [73]. For a given size we have 
generated 100 independent networks and for each we have 100 independent realizations of the 
disordered couplings. 



6.5.1 Magnetization and structure of the optimal set 

As we have seen the free energy of one realization of random capacities, has breaking points 
at certain temperatures, consequently its first derivative, the magnetization, is discontinuous 



at these temperatures (see Fig 6.2 b). To obtain the continuous magnetization curve in the 
non-homogeneous case, we need to calculate m(T) over averages of random realizations with 
different breaking points. 

The magnetization which was defined m(T) = Af/N, where Af is the size of the largest 
connected components (see Section [6~2| , has a modified definition in numerical calculations. It 
is due to the fact that Af(T > T c ) = 1 in the disordered phase, consequently the magnetization 
would be m(T > T c ) = X/N in this phase, instead of m(T > T c ) = 0. However, if we introduce 
the magnetization as: 

mm - ^ (6-8) 

then m(T) behaves like the order parameter by definition and its deviation is negligible for 
large size enough. 



In Fig 6.3 the temperature dependence of the average magnetization is shown for various 
strengths of disorder A, in a Barabasi-Albert network of N = 1024 sites. One can see that the 
sharp first-order phase transition of the pure system with A = is rounded and the magne- 
tization has considerable variation within a temperature range of ~ A. The phase transition 
seems to be continuous even for weak disorder. Close to the transition point the magnetization 



curves for uniform disorder (A = 2) are presented in the inset of Fig 6.3 which are calculated 
for different finite systems. 

Some features of the magnetization curves and the properties of the phase transition can 
be understood by analyzing the structure of the optimal set. For low temperature enough 
this optimal set is fully connected, i.e. the magnetization is m — 1, which happens for T < 
Tc — A. Indeed, the first (least connected) sites with k = ^ = 2 (i.e. those which have only 
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Figure 6.3: Temperature dependence of the average magnetization in a Barabasi-Albert network of 
N — 1024 sites for different strength of the disorder, A. At T = Tc = 2 the magnetization is 
independent of A > and its value is indicated by an arrow. Inset: The average magnetization for 
uniform disorder, A = 2, close to the transition point for different finite sizes. The arrow indicates the 
critical point of the infinite system. 



outgoing edges) are removed from the fully connected diagram, if the sum of the connected 
bonds is X)f=i J% < T, which happens when the temperature reaches the range T > T c (0) - A. 
From a similar analysis, it follows that the last edges leave the optimal set as the temperature 
approaches T < + A and the optimal set becomes empty for any finite system for T > 
Tc°^ + A, where the magnetization m = 0. 

The magnetization can be estimated for T — (T^ — A) <C 1 at the vicinity of the lower 
temperature bound. Since the distribution of edges is uniform, its probability density function 
is p(Ji) = 1/A, thus the probability that the sum of capacities of arbitrary chosen n edge is 
smaller than T can be calculated as: 



T rT-,h r-T-.h-. ..-./„_i 
T c -A JT C -A JT a -A 



P(J 1 + J 2 + ... + J n <T) = -^l I ... / ,/./„. ..<!.!, !<).<)) 



For the numerically studied model with A = 2, as the temperature is increasing, the less 
connected sites with fj, = n = 2 number of edges become unconnected first when the capacities 
of its two edges become Ji + J2 < T. Following from Eq |6.9| it occurs with the probability 
P(Ji + J2 < T) = T 2 /8 whereby the magnetization starts to decrease from 1 as: 

m(T) w 1 - ^- (6.10) 

which is indeed a good approximation for T < 1. 

In the temperature range T c (0) - A < T < T c (0) + A typically the sites are either isolated 
or belong to the largest cluster. There are also some clusters with an intermediate size, which 
are dominantly two-site clusters for T < and their fraction is less than 1%, as shown in 
Fig 6.4 The fraction of two-site clusters for A = 2 and T < — 2 can be estimated as 
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Figure 6.4: Fraction of intermediate size clusters as a function of the temperature. Here Nms denotes 
the number of middle size clusters which are neither included into the largest component nor isolated 
one-site clusters. 



follows. First, we note that since they are not part of the biggest cluster they can be taken 
out of a fraction of p\ — 1 — m(T) sites. Before being disconnected a two-site cluster has 
typically four bonds and three of them connect to the biggest cluster, denoted by J\, J 2 and 
J3. When it becomes disconnected we have J\ + J 2 + J3 < T, which happens with a probability 



P2 = T 3 1 (6A 3 ) = T 3 /48 calculated from Eq 6.9 At the same time the coupling within the two- 
site cluster should be J 4 > T, which happens with probability p 3 = (T c (0) - T)/A = (2 - T)/2. 
Thus the fraction of two-site clusters is approximately: 

n 2 »pj xp 2 xp 3 «T 5 (2-T)/768 (6.11) 



where we used the subs titution of Eq 6.10| This form describes well the general behavior of the 



distribution in Fig|6.4| when T < . In the temperature range T > the intermediate 



clusters have at least three sites and their fraction is negligible, which is seen in Fig 6.4 Con- 
sequently the intermediate size clusters do not influence the properties of the phase transition 
in the system. 

We note an interesting feature of the magnetization curves in Fig|6.3| that they cross each 



other at the transition point of the pure system, at Tc^ = 2, having a value of m(Ti°^) — 0.58, 
for any strength of disorder. This property follows from the fact that for a given realization of 
the disorder the optimal set at T — Ti°' only depends on the sign of the sum of fluctuations of 
given couplings (c.f. some set of sites are connected (disconnected) to the giant cluster only for 
positive (negative) accumulated fluctuations) and does not depend on the actual value of A > 0. 
In other words at this point the cooperation depends on the fact that a collaboration is favorable 
or not and does not depend on that intensity. However, the slope of the order parameter curves 
are different at this point since they are not the same functions of the temperature. 

In the ordered phase, T < T c , the largest connected cluster contains a finite fraction m(T) < 1 
of sites. Since the backgrounding graph has a scale-free behaviour, the question arises about the 
topology of this cluster as a function of temperature. We have analyzed the degree distribution 
of this giant cluster in Fig. |6.5| and found a scale-free behavior for any temperature T < T c 
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with the same degree exponent, 7 — 3, as for the original Barabas- Albert network. 
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Figure 6.5: Degree distribution of the largest cluster at different temperatures in a finite network with 
TV = 2048. The dashed straight line indicates the range of the critical temperature. 

Following from earlier works, it was shown that networks with scale-free degree distribution 
shows a special behaviour against destruction. Those structure have high tolerance against 
charges, if the sites are canceled randomly, but break down rapidly if always the highest con- 
nected nodes are removed [16,194]. During the evolution of the optimal set the highly connected 
sites, which hold together the cluster and induce scale-free behaviour, are secured by their large 
number of bonds. As the temperature increases always the weakest points with small degree 
and(or) capacity are detached, thus the core of the connected component retains its scale-free 
features until it splits up at the critical point. 

We can thus conclude the following picture about the evolution of the optimal set. This is 
basically one large connected cluster with Af sites, immersed in the see of isolated vertices. 
With increasing temperature more and more loosely connected sites are dissolved from the 
cluster, but for T < T c we have Af/N = m(T) > and the cluster has the same type of 
scale-free character as the underlaying network. On the contrary, above the phase-transition 
point, Tc^ + A > T > T c , the large cluster breaks up for finite extent, Af < 00, and it loose its 
scale-free feature. 

The order of the transition depends on the way how Af behaves close to T c . A first-order 
transition, i.e. phase-coexistence at T c does not fit to the above scenario, thus it takes place 
only in homogeneous case. Indeed, as long as Af ~ N the same type of continuous erosion of the 
large cluster should occur in the system, i.e. the transition is of second order for any strength 
A > of the disorder. Approaching the critical point one expects the following singularities of 
the magnetization and the largest correlated cluster: 

m{T) ~ (T c - Tf and AT ~ (T - T c )- V ' (6.12) 

on different sides of the critical point. Finally, at T — T c the large cluster is supposed to have 
Af ~ N 1 ~ x sites, with exponent x = j3/v' . 
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6.5.2 Distribution of the finite-size transition temperatures 

The first step in the study of the critical singularities is to locate the position of the phase- 
transition point. In this respect it is not convenient to use the magnetization which approaches 
zero very smoothly (see the inset of Fig 6.6 1 so that there is a relatively large error by calculating 
T c in this way. 




Figure 6.6: Demonstration of the magne- 
tization m(T) and the distribution Pd(T) 
of the finite-size transition temperature 
at the vicinity of the phase transition 
point. Ps(T) gives the probability that 
a sample survives until a given temper- 
ature. By definition Pd{T) is the prob- 
ability mass function of P S {T) so the 
peak of Pd{T) distribution is related to 
point with the highest slope of the P s (T) 
curve. The distributions were generated 
from average measurements of the size 
N = 512 and A = 2. 



One might have, however, a better estimation by defining for each given sample, say a, 
a finite-size transition temperature T c (a,N), as has been made for regular lattices [73,74, 
80]. For regular lattices it is defined as the temperature which separates two qualitatively 
different regime, in which the largest correlated cluster percolates from that in which it does 
not. However the cluster percolation is meaningless in case of scale- free networks, and the 
transition here is continuous between the two states, so we define this finite-size transition 
point as the temperature when the largest connected component becomes smaller than a given 
size. For a network we use a condition for this size: AT(T) ~ AN 1 ^ X , in which x is the 
magnetization critical exponent and A = 0(1) is a free parameter, from which the scaling form 
of the distribution is expected to be independent. 

First to allocate the exponent x we made a self-consistent calculation as follows. We assumed 
that the critical size of the largest connected component which identifies T c (a,N) is smaller 
than any power of the system size so we have started with a logarithmic initial condition, 
M{T) ~ A In N, which means formally x\ — 1 (A/"(T) ~ AN ). Then for a fixed A we have 
determined the distribution of the finite-size transition temperatures and at their average value 
we have obtained an estimate for the exponent, x — X2- Following that the whole procedure 
is repeated with x s = X2, etc. until a good convergence is obtained. Fortunately the distribu- 
tion function, P(T C ,N), has only a weak x-dependence thus it was enough to make only two 
iterations whereafter we have obtained X2 — 0.69. Then in the next step the critical exponents 
were converged within the error of the calculation and they were found to be independent of 
the value of A, which has been set to be A = 1,2 and 3. 

The distribution of the finite-size critical temperatures calculated with X2 — 0.69 and A = 3 
are shown in Fig |6.7| for different sizes of the network. One can observe a shift of the position 
of the maxima as well as a shrinking of the width of the distribution with increasing size of the 
network. The shift of the disordered average value, T^ V (N), is asymptotically given by [195]: 

T? V (N) - T c (oo) ~ AT 1 /*' , (6.13) 
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Figure 6.7: (a) Distribution of the finite-size transition temperatures for different sizes of the Barabasi- 
Albert network, (b) Scaling c ollaps e of the d ata in terms of t = (T C {N) -T? v (N) + AN~ 1/V ' ) / AT C (N), 
using the scaling form in Eqs 6.13 and 6.14 with v 1 = 3.8(2), and v' = 5.6(2). 



whereas the width, characterized by the mean standard deviation, AT C (7V), scales with another 
exponent, v' ', as: 

AT C (N) - N- 1/u ' . (6.14) 

First to determine the v' exponent and the T c (oo) transition point we applied two independent 
methods. Using Eq6.13 from a three-point fit we have obtained v' — 3.8(2) and T c (oo) = 
3.03(2). Another possible way is by plotting the difference T^ V (N) — T c (oo) vs. N in a log-log 



scale for different values of T c (oo), see Fig 6.8 At the true transition point according to Eq 6.13 



there is an asymptotic linear dependence, which is indeed the case around T c (oo) 
the slope of the line is compatible with 1/v' = .27(1). 

For the width exponent, 
5.6(2). 



3.03(2) and 



we obtained from Eq 



6.14 with two-point fit the estimate: 



With these parameters the data in Fig |6.7 a can be collapsed to a master curve as 
shown in the Fig |6.7| b. This master curve looks not symmetric, at least for the finite sizes used 
in the present calculation. It could be explained by the definition of the finite-size transition 
temperature distribution, which is actually a distribution of maximum values. Following from 
this extreme statistic feature it can be well fitted by a modified Gumbel distribution: 



r( w ) 



( e -«-«-»y 



(6.15) 



with a parameter u> = 4.2. We note that the same type of fitting curve has already been used 
in [195]. For another values of the initial parameter, A = 1 and 2 the estimates of the critical 
exponents as well as the position of the transition point are found to be stable and stand in the 
range indicated by the error bars. 

The equations in Eqs |6.13| and |6.14 are generalizations of the relations obtained in regular 
d-dimensional lattices [196-201] in which N is replaced by L d , L being the linear size of the 
system and therefore instead of v' and V we have v = v 1 Jd and v = v' /d, respectively. Generally 
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Figure 6.8: Shift of the average finite-size transition temperatures, T^ V (N) — T c (oo), vs. N in a log-log 
scale plotted for different values of T c (oo). The lines connecting the points at the same T c (oo) are 
guide for the eye. At the true transition point the asymptotic behavior is linear which is indicated by 
a dotted straight line. 



at a random fixed point the two characteristic exponents are equal and satisfy the relation [202] 
1/ = v 1 > 2. This has indeed been observed for the 2d [73] and 3d [74,80] random bond Potts 
models for large q at disorder induced critical points. On the other hand if the transition stays 
first-order there are two distinct exponents [203,204] v' — 1 and v' = 2. 

Interestingly our results on the distribution of the finite-size transition temperatures in net- 
works are different of those found in regular lattices. Here the transition is of second order 
but still there are two distinct critical exponents, which are completely different of that at a 
disordered first-order transition. For our system v' > which means that disorder fluctua- 
tions in the critical point are dominant over deterministic shift of the transition point. Similar 
trend is observed about the finite-size transition parameters in the random transverse-field Ising 
model [205], the critical behavior of which is controlled by an infinite randomness fixed point. 
In this respect the random bond Potts model in scale-free networks can be considered as a new 
realization of an infinite disorder fixed point. 



6.5.3 Size of the critical cluster 

Having the distribution of the finite-size transition temperatures we have calculated the size 
of the largest cluster at T* V {N), which is expected to scale as N[N, T™(N)] ~ N 1 ' 00 . Then 
from two-point fit we have obtained an estimate for the magnetization exponent: x = .66(1). 
We have also plotted Af[N, T^"(N)] vs. N 1 ^ x in Fig 6.9 for different initial parameters A. Here 
we have obtained an asymptotic linear dependence with an exponent x = .65(1), which agrees 
with the previous value within the error of the calculation. 



6.6 Summary 

In this chapter we have studied the properties of the Potts model with large value of q on 
evolving scale-free networks, such as the Barabasi-Albert network, both with homogeneous and 
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Figure 6.9: Size dependence of the critical cluster at the average finite-size critical temperature as a 
function of N 1 ~ x with x = .65. The date points for different initial parameters A are well described by 
straight lines, which are guides to the eye. 



random ferromagnetic couplings. This problem is equivalent to an optimal cooperation problem 
in where the agents try to optimize the total sum of the benefits coming from pair cooperations 
(represented by the Potts couplings) and the total sum of the support which is the same for each 
cooperating projects (given by the temperature of the Potts model) . The homogeneous problem 
is shown exactly to have two distinct states: either all the agents cooperate with each other or 
there is no cooperation between any agents. There is a strongly first-order phase transition: by 
increasing the support the agents stop cooperating at a critical value. 

In the random problem, in which the benefits are random and depend on the pairs of the 
cooperating agents, the structure of the optimal set depends on the value of the support. 
Typically the agents are of two kinds: a fraction of m belongs to a large cooperating cluster 
whereas the others are isolated, representing one man's projects. With increasing support more 
and more agents split off from the cluster, thus its size, as well as m is decreasing, but the cluster 
keeps its scale-free topology. For a critical value of the support m goes to zero continuously and 
the corresponding singularity is characterized by non-trivial critical exponents. This transition, 
as shown by the numerically calculated critical exponents for the Barabasi-Albert network, 
belongs to a new universality class. One interesting feature of it is that the distribution of 
the finite-size transition points is characterized by two distinct exponents and the width of the 
distribution is dominated over the shift of the average transition point, which is characteristic 
at an infinite disorder fixed point [205] . 

An interesting question arises concerning to the validity of the Harris criterion on complex 
networks in case of spin systems which exhibits a second-order phase transition in the absent 
of disorder. This question have been studied on different complex structures like lattices with 
aperiodically distributed interactions, hierarchical lattices where an analogous criterion (also 
called Harris-Luck criterion [206]) of relevance of the geometric fluctuations have been found 
for the critical (second-order) behaviour [207-209]. In small- world networks this modified rele- 
vance criterion can be seen also which in this case depends on the strongness of the long-range 
interactions [210]. In case of scale-free networks we believe that this criterion is satisfied also 
however not in its original form since it depends on the dimension which is defined here as 
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the fractal dimension of the network. Probably here the relevance-irrelevance criterion would 
depend on the degree exponent of the network also, which determine the density long-range 
interactions in the network. 

The above investigated optimal cooperation model is a good approximation of a large set of 
cooperation process in physics, sociology or economy etc. However, we need to keep in mind 
that the optimal cooperation algorithm is a Monte Carlo method to calculate an equilibrium 
state of a system of cooperating agents. At this state the free energy of the total system is 
minimized and the condition of detailed balance is satisfied. However in a real social system 
this state is unreachable, since the system is always out of equilibrium and the detailed balance 
condition is not held. Consequently the optimal cooperation method does not describe the real 
social systems as they are, but it provides important predictions about the system. It gives the 
best cooperated situation with the "lowest energy" what the system could ever reach. In real 
systems the backgrounding network is changing in time plus there are some important social 
parameters which influence the agents, and then they do not take the optimal decisions always. 
Consequently a social system is always in an excited "higher energy" state which can be close 
to equilibrium, but never the same in deed. In these excited states the sub-modular property 
of the free energy is expected to hold, but no effective algorithm has found so far to calculate 
these states. Moreover, even a social system would evolve toward to the equilibrium state, the 
time scale we can observe it is too short to see this relaxation. 

At the same time, the structure of this kind of interacting networks usually is well described 
by scale-free graphs. Thus the common consideration of these two models gives a possible 
relevance in real applications even the aim of our study was to understand the problem from a 
fundamental point of view. 

All the results of this chapter were published in a recent paper by Marton Karsai, Jean- 
Christian Angles d'Auriac and Ferenc Igloi in the Physical Review E 76 041107 in 2007 [24]. 
This article gave also the ground for the presentation of some parts in the previous chapter. 
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Chapter 7 

Density of critical clusters in 
strips of a strongly disordered 
system 



7.1 Introduction 

Every experimental system is geometrically constrained and finite therefore shape a surface, 
what leading to the fact that we have to discriminate between its bulk and surface properties. 
This description is justified as long as the correlation length is much smaller than the system size. 
However, at the critical point where correlation length is divergent and domains of correlated 
sites appear in all length scales, it is more appropriate to describe the position dependent 
physical properties of the system by density profiles rather than bulk and/or surface observables. 

The correlated domains are most easily visualized for percolation [211], in which the domains 
are the connected clusters, as we have seen in Section |2.3.3[ At the same time in discrete spin 
models, such as the Ising and the Potts models, domains of correlated spins can be identified in 
different ways, for example using geometrical clusters [212] (also called Ising or Potts clusters) 
which are domains of parallel spins. In two dimensions, geometrical clusters percolate the 
sample at the critical temperature and their fractal dimension df can be obtained through 
conformal invariance [213-216]. This df is generally different from the fractal dimension of 
Fortuin-Kastclcyn representation [58] which is another possible method to represent correlated 
clusters. The domains here are identified by graphs of the high-temperature expansion. Its 
fractal dimension is directly related to the scaling dimension of the magnetization as d = df+Xf,, 



where d denotes the spatial dimension of the system (see Section 2.2.41. From a geometrical 



cluster, the Fortuin-Kasteleyn cluster is obtained by removing bonds with a probability, 1 — p - 



e~ Kc , where K c being the critical value of the coupling (see Section 2.3.21. 

In finite geometries such as strips or squares, one is interested in the spanning probability 
of critical correlated clusters and universal behaviour of different crossing problems. For two 
dimensional percolation many exact and numerical results have been obtained in this field [217- 
225]. However, another interesting problem is the density of clusters in restricted geometries 
[226] , which is defined by the fraction of samples for which a given point belongs to a cluster 
with some prescribed property, such as touching the edges of infinite and half-infinite strips, 
squares, etc. This latter problem is analogous to the calculation of order parameter profiles 
in restricted geometries, which has been intensively studied through conformal invariance and 
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numerical methods [227-241]. 

This density behaviour of critical clusters is expected to hold in any two dimensional systems 
which represent continuous phase transition where at the critical point the correlation length 
is divergent and the system becomes scale and conformal invariant. In case of the q-state Potts 
model, following from exact results [77] in two dimension a continuous phase transition takes 
place if the number of spins states is q < 4 and the conformal invariance behaviour is expected 
to hold. 

In case of disorder the correlated clusters are defined also. In such systems the physical 
observables (magnetization profile, cluster density, etc.) are averaged over quenched disorder. 
In isotropic cases conformal symmetry is expected to hold at the critical point so that average 
operator profiles and average cluster densities are expected to be invariant under conformal 
transformations. Among disordered systems an interesting class is represented by such models 
in which the transition in the pure version is of first-order, but in the disordered version the 
transition softens into second order (see Section 2.4. 1[ ) [242] . This type of random fixed point can 
be found, among others, in the two-dimensional random bond Potts model for q > 4 [243-248]. 
As we have seen in Section |2.3.2| this model can be represented by Fortuin-Kasteleyn random 
cluster method where the critical properties are influenced by strong-disorder effects. 

When q < oo, in the partition function of the random cluster representation the different 
clusters are needed to be considered with the related Boltzmann weights. However, in the q = oo 
limit for a given realization of bond disorder its high-temperature expansion is dominated by a 
single graph, the so-called optimal diagram where the weights can be only zero or one thus the 
calculation of the optimal graph is simpler (see Section 2.3.5| 2.4.2 and 6.2). Clusters in the 
optimal diagram are isotropic, and the density of clusters is obtained through averaging over 
disordered realizations. 

Very recently the density of critical percolation clusters is studied in different two-dimensional 
restricted geometries and presumably exact expressions are obtained through conformal invari- 
ance. The same results are expected to hold for the densities of Fortuin-Kasteleyn clusters in 
two-dimensional conformal invariant systems also. In this chapter we study the density of crit- 
ical clusters of the random bond Potts model in large-g limit represented by Fortuin-Kasteleyn 
clusters and compare our numerical averages to exact analytical results obtained for percola- 
tion through conformal invariance. First we shortly introduce some exact analytical results 
calculated for percolation in strips [226] , then we compare them to numerical results of critical 
density profiles, calculated in the disordered Potts system. We close this chapter with our 
conclusions. 



7.2 Density of critical percolation clusters in strips 

Critical cluster density profiles can be calculated exactly for two-dimensional percolation 
systems through conformal invariance. Here we recapitulate some of these results which are 
valid for an infinite strip of width L 3> 1 in the continuum limit. The position of a point is 
described by the distance I from the strip boundary (/ ^> 1), and the scaling variable is defined 
as y = l/L = 0(1) which is between < y ^ 1. 

First we consider the density of clusters which span the sides of an infinite strip. We proceed 
from a complex half plane and determine the critical density profiles using conformal trans- 
formations. It has been shown [9, 226, 237, 249] that in an upper half plane the density p of 
clusters, which are connected to the boundary in an interval (^1,^2) is: 
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where Xf, is the scaling dimension of the bulk order parameter and z G C is a point on the 



complex half plane (see Section 2.2.51. Here F(rj) takes one of the two forms of: 

( 



^(VT^J (7 - 2) 

where x s denotes the scaling dimension of the surface order parameter [249] . These results are 
exact in case of critical percolation where Xb = 5/48 and x s = 1/6, however we hypothetically 
assume that they are valid for another conform invariant systems with different values of Xb 
and x«. 



If in Eq 7A we parametrize z as z — e and set x\ — > and x 2 — > oo, then the argument of 
F(rf) in Eq 7.1 can be written as r\ = 1 — e 2t0 . Using this parametrization the critical densities 



can be written of the form: 

p+(r, 9, xx -> 0, x 2 -> oo) cx {rsin9)- Xb [cos(0/2)f a (7.3) 
P-(r,e,Xi^Q,x 2 ^oo) oc (rsh-i9)- Xb [sm(6/2)] x ° (7.4) 

where p + (r,9) denotes the critical density attached to the positive real axis and p-(r,9) = 
p+(r, tt — 9) is the density of clusters attached to the negative real axis on the semi-infinite 
complex plane at a distance r from the boundary. 

The density of clusters connected to an arbitrary point of the boundary is independent of X\ 
and X2- Following from the exact result of Fisher and de Gennes [250] this is related to the 
order parameter profile varies as (<f)(z,z)) oc (z — z)~ Xb which can be also written as: 

p e (r,9) oc (rsm9)- Xb (7.5) 

The densities, introduced in Eq |7.3|7.4] and |7~5"| are unnormalized, however close to the boundary 
they are all dominated by the fixed boundary so they may be normalized relative to one another. 
Next we map the half infinite plane onto an infinite strip, following some conformal transfor- 



mation defined in Eq 2.33 as 



w(z) = x + iy = — ln(z) = —(lnr + i9) I (7-6) 
7T 7T I = 

where x S (— oo, oo) and y S (0, 1). In the new geometry, the critical densities are transformed 
also. The density profile of clusters which touch at least one of the boundary (or both) irre- 
spective to the other, say as y — l/L — * (or y = l/L — > 1), can be deduced from the density 



defined in Eq 7.3 (or Eq 7.4). They are given by 



p (y) oc (sinTry) Xb [cos^-j , Pl (y) oc (sinTry) Xb (^in^y J (7.7) 

They are related to each other as P i(y) = po(l — y) and they are analogous to the order 
parameter profile in the system with fixed-free boundary conditions [231,232]. 

The density contains clusters which touch the boundary either at I = 1 or I = L or both, 
arising from Eq |7.5| of the form: 

p e (y) oc (shiTTy)-* 6 (7.8) 

which corresponds to the order parameter profile with parallel fixed boundary conditions [227] . 

In a simple manner we can find the density of spanning clusters Pb(y), which touch both sides 
of the infinite strip. Adding P q and p\ includes all configurations that touch either boundaries, 
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but double counts the clusters that touch both sides of the strip. Subtracting p e leaves only 
those clusters that touch both boundaries. Thus a simple relation arises like [226]: 



Pb(y) = Paiv) + pi(y) - p e (y) 



which leads to the expression for pb(y) given by: 
p b (y) oc (simry)~ Xb 



cos T l 



. wy 
sin — 
2 



1 



(7.9) 



(7.10) 



The results in Eqs |7.7[ |7.8| and |7.10| are derived for percolation, however it is expected that 
they also hold for the densities of Fortuin-Kasteleyn clusters in two-dimensional conformal 
invariant systems. During this work we refer to the analogous expressions for order parameter 
profiles, assume that Eq |7.7| and Eq |7.8| are valid for conformal invariant models since they 
follow from conformal consideration. On the other hand, the third density Pb{y) in Eq 7.10 is 
expected to be valid also, since it can be expressed using the two previous ones. 



7.3 Clusters in the optimal set of the random bond Potts 
model 

The investigated strongly disordered system, which can be represented by Fortuin-Kasteleyn 
cluster method and presents conformal invariant behaviour at its criticality is the random bond 
Potts model in large g-limit, as we mentioned in the introduction. The Hamiltonian of the 
model is defined in Eq |6.1| and according to our earlier recognitions, the partition function is 
dominated by an optimal set, which analogous to the set of connected bonds in percolation 
problems. The phase transition of the model is of first order at the pure case, when each bond 
have the same weight Jij — J and it softens to a second oder transition for an arbitrary small 
disorder. Here we are going to study the disordered case of this model and investigate the 
density of clusters in the optimal set in strip geometry. 

In our system the df fractal dimension of the infinite cluster at the critical point and the X}, 
scaling dimension of the bulk magnetization are related to the golden- mean ratio, <P = (1+V5/2) 
as [73]: 

•h-i+Z *-i-t-*-=^ (7.1D 



where we used Eq 2.26 The analogous surface quantities are conjectured to be: 

d} = \, x s = \ (7.12) 

During our study we use a discrete bimodal form of disorder, when the reduced couplings 
Kij = (3Jij (where ^ K%j ^ 1) can take values following a distribution of: 

PbiKij) = P 6(K - A - K^) + (1 - P )S(K + A - K iS ) (7.13) 

where K denotes the average reduced couplings and we choose p = 1—p =1/2, which defines the 
distribution symmetrical. Generally we study the critical point of the system which is located 



at K = K c = 1/2 following from self-duality (see Section 2.4.2 and [81]) and it is independent 
of the strength of disorder: ^ A ^ 1/2. Note that the pure system is obtained for A = 0, 
whereas for A = 1/2, when just strong bonds are presented in the system, we get back the 
traditional percolation problem. 
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Figure 7.1: Optimal diagrams of the random bond Potts model for three realizations of the disorder of 
different strength. Lower panel, A = 1/2, standard bond percolation; middle panel, A = 5/12; upper 
panel, A = 4/12. We have used different colors to visualize the different type of clusters in the optimal 
diagram: spanning clusters [black] , clusters which touch only the upper (lower) boundary of the strip 
[red (green)] and clusters which have no common points with the boundary [yellow]. Note that the 
breaking-up length is increasing with decreasing A. 



The evaluation of the optimal diagram with decreasing values of A is shown in Fig |7.1| Here 
one can see that with decreasing A, the clusters become more compact. To characterize this 
effect we define a length-scale, the so-called breaking-up length, If,: in a finite system of linear 
size L < If, the optimal diagram is typically homogeneous (either empty of fully connected) and 
for L > If, it contains both empty and connected parts. If we want to determine If,, we fix the 
size of the system, L, and for a given distribution of the bonds decrease A until A&, where the 
optimal set becomes fully connected. Repeating this calculation for several realizations of the 
disorder we obtain an average value Af,, to which the breaking-up length is just L — If,. If, is a 
rapidly increasing function of 1/A, for small A it behaves as [73]: 



It, w exp 



.4 



(7.14) 



In a numerical calculation on a finite sample one should have the relation, L ^> If,, thus A should 
be not too small. On the other hand one should also be sufficiently far from the percolation 
limit, A = 1/2, in order to get rid of cross-over effects. This means that the optimal choice 
of A is a result of a compromise, which in our case seems to be around A = 5/12, when the 
typical breaking-up length is about If, ~ 14. Most of our studies are made for this value, but in 
order to check universality, i.e. disorder independence of the results, we have made also a few 
calculations for A = 21/48 also. 

To calculate the optimal diagram of a given realization of disorder we use the combinatorial 
optimization algorithm that we defined in Section |4.3| and which works in strongly polynomial 
time. Application of this method make possible to obtain the exact optimal diagram for com- 
paratively large finite systems. In order to have an effective strip geometry we have considered 
lattices of rectangle shape with an aspect ratio of four. The strips have open boundaries along 
the long direction and periodic boundary condition was used in the other direction. We men- 
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tion that the same geometry has been used before for percolation, too [226]. The width of the 
lattices we considered are from L — 32 up to 256 (i.e. the largest systems contained 262144 
sites) and for each sizes we have considered 1000 samples, except for L = 64 and 128, when we 
had 1509 and 2128 samples, respectively. These calculations were performed on a cluster of 16 
quadricore processors during more than a month. 



7.4 Densities of critical clusters 

In the following section we are going to present and analyze our average numerical results 
of density of critical clusters of the random bond Potts model and compare those to the exact 
analytical results obtained by conformal mapping for critical percolation [226,249]. 



7.4.1 The pb(y) cluster density 

We start to study the density of crossing clusters, pb(l/L), using the scaling form of which is 
conjectured in Eq |7.10| for conformal invariant systems. For the random bond Potts model the 



numerically calculated normalized densities pb(l/L), for different widths are shown in Fig 7.2 



The data for different widths fit to the same curve and the finite breaking-up length lb, seems 
to have only a small effect. 




Figure 7.2: Normalized density profiles pt(l/L), of the random bond Potts model for different widths. 
The standard deviation of the calculated points is smaller than the size of the symbols. The dashed line 
indicates the conformal result in Eq |7.10| with the conjectured exponents in Eq |7.11| and Eq |7.12| using 
the boundary parameter a = 0. defined in Eq ]7.16| In the inset the ratio of simulation to theoretical 
results are presented for L — 256 with two different boundary parameters: a — —0.5 and a — —1.0, see 
EqP 



7.16 



In the surface region I <C L, but I > lb, one expects from scaling theory: 

p b (l) ~ (7.15) 
which is in accordance with the limiting behavior of the conformal prediction in Eq |7.10| In 



Fig 7.3 we have presented pb(l) in a log-log plot in the surface region for the largest finite system. 
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Indeed, for I > If, the points are well on a straight line, with a slope of which is compatible 
with the conjectured value: x s — Xb = 0.309. We have also estimated the asymptotic slope 
of the curve by drawing a straight line through the points in a window [ij, + 1/2, £& + 31/2] by 
least square fit. Fixing 4 = 15 the estimates with varying / seem to have a ~ I 2 correction (see 



the inset of Fig 7.2) and the extrapolated slope IS X g X — 0.303(8) in agreement with the 
conjectured values in Eq |7.11| and Eq |7.12| 

We have also checked the conjectured form of the profile in Eq |7.10| using the scaling exponents 



in Eq 7.11 and Eq 7.12 which indeed fits very well the scaling curve for the random bond Potts 
model for the whole profile. We calculated the ratio of the simulation to the theoretical results. 
However, when we compare the numerical results on a finite lattice to the results of continuum 
theory, the question arises due to finite-size and edge effects, of what value of the continuous 
variable y should correspond to the lattice variable I, specially close to the strip boundaries [226]. 
The density at the vicinity of the boundaries at I = 1 and / = L goes to zero, which suggests a 
simple assignment to the continuous variable like y = l/L as we applied generally. However we 
can get a better fit to the data near to the boundaries by assuming that the effective position of 
the boundary is at a distance a (in units of the lattice spacing) beyond the lattice boundaries. 
This is accomplished by defining a continuum variable y as: 

y= (l + a)/(L + 2a) , (7.16) 

In such a way I = —a corresponds to y — and I = L + a corresponds to y — 1. By varying 
a from to —1 one obtains a better fit in the boundary region, but at the same time the bulk 
part of the profile remains practically unchanged. As seen in the inset of Fig |7.3| in the bulk 
part of the profile the non-systematic fluctuation of the ratio around unity is typically 1-2%. 




Figure 7.3: Density profile, pb(l), of the random bond Potts model for L = 256 close to the surface in 
log-log plot. The straight line has a slope x 3 — £E& — 0.309. Inset: estimates of the slope using different 
windows of the fit, see the text. Here the full line indicates a parabolic fit. 
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Figure 7.4: Density profiles, po(l/L), of the random bond Potts model for different widths which 
approach the same scaling curve at the free boundary y = 1. The standard deviation of the calculated 
points is smaller than the size of the symbols. The extrapolated values for l/L > 0.5 are denoted by 
red squares. The dashed line indicates the conformal result in Eq|7.7| with the conjectured exponents 



in Eqs 7.11 and 7.12 



7.4.2 The po(y) cluster density 

At second we consider the density pq(1/L) of those clusters which are touching one boundary 
of the strip including the spanning clusters, compared to the scaling form of which is conjectured 
in Eq|7.7| This density is analogous to the order parameter profile in the system with fixed-free 



boundary conditions [231,232]. The numerically calculated densities are shown in Fig 7.4 for 
different L widths. 

The profiles at the fixed boundary y — 0, are perturbed by surface effects, which are due to 
the presence of the finite breaking-up length. Indeed in terms of the scaled variable y = l/L, 
the size of the perturbed surface region, y^ is a decreasing function of L. On the other hand at 
the contrary boundary y = 1, where the profiles are not influenced by the fixed surface at y = 
and the clusters touching both boundaries dominate, the densities approach the same scaling 
curve, which in the vicinity of the boundary behaves as po(y) ~ (1 — y) Xs ~ x *> . Comparing the 
scaling curve with the conformal prediction in Eq |7.7| we obtain an overall good agreement for 
1 > y > 0.5. In the region y < 0.5, where the finite-size profiles deviate more strongly from 
each other we used an extrapolation procedure. At a fixed y we have plotted po(y) as a function 
of l/L and from this we have estimated the value of the scaled curve as L — > oo. With this 
method we have obtained estimates in the region 0.2 > y, which are in agreement with the 
conformal result as seen in Fig |7.4| 

Turning back to the finite-size dependence of the densities at the fixed surface, y — 0, we 
note that in the continuum limit, in case of (j < ( < L, the scaling form of the density is 
described by the result of Fisher and de Gennes [250]: po(l) ~ l~ Xh as we discussed in Section 
7.2| However by approaching the breaking-up length, lb, the increase of the profile is stopped 
and for I < 1^ po(l) starts to decrease. This is due to the structure of the connected clusters 
close to the surface. As seen in Fig|7.1|the number of touching sites in a cluster is comparatively 



smaller for the random bond Potts model with A < 1/2 (upper and middle panel of Fig 7.1 1 



than for percolation with A = 1/2 (lower panel of Fig 7.1l. Also for finite widths the small 
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and medium size touching clusters are rarely represented for the random bond Potts model. 
By approaching with I the other, free side of the strip the crossing clusters start to bring the 
dominant contribution to the density po(l/L), which is then well described by the conformal 
formula. 



7.4.3 The p e (y) cluster density 

Finally we consider the density of points in such clusters which are touching either the 
boundary at I = 1 or at I = L or both, which is denoted by p e (l/L) and the conjectured 
conformal formula is given in Eq |7.8| This density is analogous to the order parameter profile 
with parallel fixed spin boundary conditions [227]. 




I/L 

Figure 7.5: Density profiles p e (l/L) for different widths L. These densities are strongly perturbed by 
the finite breaking-up length If, at both boundaries and fit with the expected conformal predictions 
only at the thermodynamical limit. 



For the random bond Potts model this density is strongly perturbed by the finite breaking- 
up length at both boundaries as can be seen in the Fig |7.5[ In this case we did not try to 
perform an extrapolation and conclude that even larger finite systems would be necessary to 
test the conformal predictions in a direct calculation. In order to try to test the result in Eq |7.8| 
we studied another density which is defined on crossing clusters, so that one expects it to be 
represented correctly in smaller systems, too. Here we define a density, p l * ne (l/L), in crossing 
clusters and consider points only in such vertical lines, where at both ends of the given line the 
cluster touches the boundaries. Since p^ nc (l/L) is related to the operator profile with fixed- 
fixed boundary conditions we expect that it has the same scaling form as the previously defined 



density, p e (l/L). In Fig 7.6 we show the calculated densities for the random bond Potts model, 



which are compared with the analytical prediction in Eq 7.8 A similar analysis for percolation 



is shown in the inset of Fig 7.8 In both cases we found that the numerical and analytical results 
for this type of profile are in satisfactory agreement, although the statistics of the numerical 
data is somewhat low, since just a fraction of ~ L~ 2 ' Xs ~ L^ 1 lines can be used in this analysis. 
The non-systematic fluctuation of the numerical data is less than 1% for percolation and about 
3% for the random bond Potts model. 
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Figure 7.6: Density profile along a vertical line with two touching boundary points, p^ ne (l/L), for the 



random bond Potts model. The solid curve indicates the conformal result in Eq ]7.8| with the conjectured 
exponents in Eq |7.f f | and Eq |7.f 2| In the inset the same quantity is shown for percolation. Here in the 
analytical formula in Eq 7.8 we use Xb = 5/48 and x s = 1/3, the scaling dimension values of the bulk 
and surface magnetization for percolation. In both figures the boundary parameter in Eq 7.16 is a — 0. 



7.5 Summary 



In this chapter we have studied the density of critical clusters in a model with critical proper- 
ties of which are dominated by disorder effects. Our study is motivated by a recent investigation 
about ordinary percolation in [226] in which the densities are calculated in the continuum ap- 
proximation through conformal invariance. Here we have suggested the generalization of these 



analytical results for another conformal invariant system in Eqs 7.10 7.7 and 7.8 To test these 
predictions we have studied numerically the density of Fbrtuin-Kasteleyn clusters in infinite 
strips of the two-dimensional random bond Potts model in the large-g limit. This model is 
expected to be conformal invariant, which means that average quantities which are related 
to Fortuin-Kasteleyn clusters (such as correlation function and magnetization densities) are 
invariant under conformal transformations. 

In the actual work we have calculated the density of points of different type of clusters 
(crossing clusters, clusters which touch one boundary of the strip, etc.) in analogy with a 
related study of percolation in [226]. We can thus conclude that all these critical densities 
we considered here for the random bond Potts model are found to be in agreement with the 
conformal predictions in Eqs 7.10 7.7 and 7.8 in which we have used the scaling dimensions of 



the random bond Potts model in Eq 7.11 and Eq 7.11 From an analysis of the profile, pbil), 
close to the boundary we have obtained new accurate estimate of the critical exponent, x s — Xf,, 
giving further support of the conjecture in Eq |7.11| and Eq |7.12| As far as the full profiles are 
considered they are well described by the conformal continuum predictions at least for lengths 
which are larger than the breaking- up length, lb- Consequently our study has given support for 
the possible validity of the conjectured results. 

Our investigations can be extended into different directions. For two-dimensional classical 
systems one can study the density of Fortuin-Kasteleyn clusters in the g-state Potts model, 
both without disorder (for q < 4) and in the presence of disorder (for general value of q) and 
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one can consider another type of geometries (semi-infinite strip, square, etc) as well. 

The above presented results were published in a recent paper wherefrom some parts of the 
corresponding chapter were taken. This paper was written by Marton Karsai, Istvan Kovacs, 
Jean-Christian Angles d'Auriac and Fcrcnc Igloi, and it was published in the Physical Review 
E, 78, 061109 in 2008 [25]. This article contains results of the quantum random transverse-field 
Ising chain which are not included into the dissertation. 
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Chapter 8 

Non-equilibrium dynamics of 
triangular antiferromagnetic 
Ising model at T = 

8.1 Introduction 

The non-equilibrium relaxation of critical systems is an interesting subject that was studied 
intensively experimentally and theoretically in the last few decades [51,251-254]. Moreover, dy- 
namics out of equilibrium present some special features if the system is constrained by different 
rules e.g. arising from the non-homogeneous interactions or induced by geometrical frustrations. 
In geometrically frustrated systems structural properties forbid to minimize spontaneously the 
energy which leads to highly degenerated ground state where the system has non-zero residual 
entropy even at T = 0. 

One of the simplest model which is capable to study such behaviour is the antiferromagnetic 
Ising model on triangular lattice [95], where the frustration arises from triangular structure 
and the antiferromagnetic couplings. This system was one of the first exactly solved spin 
model in the 50s [95,255,256]. The equilibrium critical behaviour of this model was carefully 
studied at T = where the ground state dynamics is governed by fluctuation of spins where 
flipping docs not cost any energy. At zero temperature in absence of external field the two- 
dimensional system is in a critical phase since the correlation function has an algebraic decay 
and by increasing the external magnetic field at h = h c it passes through a Kosterlitz-Thouless 
phase transition [257-259] . A similar type of critical behaviour was earlier found for the XY 
model in two dimension [260] . 

The non-equilibrium dynamical behaviour is influenced by motions of topological defect (pla- 
quettes of three identically orientated spins). However, controversial results have been found 
about the characteristic rules of these motions that suggested different dynamical descriptions. 
In one way the defects were found not to be independent and joined by a Coulomb-force like 
interaction. Their motions are slowed down by a logarithmic factor which is then observable 
in dynamical quantities. Such a phenomena has been found in pure systems with topological 
defects like the XY model. This logarithmic corrected dynamical behaviour was observed by 
Moore et.al. [261] who deduced this implications from the time dependency of average defect 
densities. They suggested that the dynamical exponent z was equal to two with an additional 
size-dependent logarithmic term. However, this behaviour is not supported by the numerical 
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results of Kim et.al. [262,263] who found the defects are moving like a random walker in limited 
directions. They examined the two-points and two-times correlation functions and observed a 
subdiffusive behaviour where the spreading of correlation was governed by and effective dynam- 
ical exponent z ~ 2.33. 

Our aim is to find independent evidences to decide which paradigm is relevant to describe the 
non-equilibrium critical dynamical behaviour of the triangular Ising antiferromagnet at T = 
in absence of external field or when the h = h c critical field is applied. In earlier works the 
dynamical exponent was estimated through exponent combinations or its value was strongly 
influenced by the choice of some parameters. Here we introduce a quantity which depends only 
on the dynamical exponent z which then enables us to measure and analyze its asymptotic 
behaviour directly. This quantity is defined as the relaxation time when the system reaches its 
energy minima, after it was initiated from a random T — > oo state and quenched to T = 0. 
This relaxation time characterize the length of the non-equilibrium aging regime and possible 
to measure sample- by-sample. 

After a brief theoretical introduction, we are going to study the distribution of this relax- 
ation time which directly relates to the aging dynamics of the system thus we can use its true 
dynamical features to conclude. We also measured the two-times autocorrelation function in 
equilibrium and in the aging regime in the case of different waiting times. We examine our 
numerical results using a similar method as in [50] which will be the subject of the second and 
the third sections. We close this chapter with a short summary of our conclusions. The con- 
siderations presented in this chapter are new scientific results which have not been published, 
however the publication is in progress currently. 

8.2 The model 

The Hamiltonian of the triangular Ising antiferromagnet can be deduced from Eq |2.55| with 
J < antiferromagnctic exchange energy. Since the underlying lattice is triangular, on a single 
plaquette (three neighbouring spins) two spins can align antiparallel satisfying the antiferromag- 
netic rule but the third spin is frustrated since it cannot simultaneously minimize the energy of 
interactions with both of the other spins. So it chooses one from the two possible equal energy 
state and aligns antiparallel with one spin but parallel with the other where the coupling then 
stays unsatisfied (ferromagnetic). The lowest-energy configurations of the system is that in 
which every elementary triangle are maximally satisfied. 

The triangular antiferromagnetic Ising model in two dimensions was one of the first solved 
Ising system investigated by Houtappel in 1950 who gave the partition function of the model 
[255] . At the same year, Wannier [95] calculated exactly the density of residual entropy 5(T) 
at T = of the form: 

2 f^ 3 

5(0) = -/ ln(2 cos(x))dx ~ 0.3383 (8.1) 
* Jo 

This non-vanishing entropy suggests that the system in the thermodynamical limit and at 
T = has infinite number of ground states and the energy minima state is still exponentially 
degenerated in case of finite size. To calculate thermodynamical averages, we need to pass 
through this equilibrated configuration space of possible ground states. If we derive the spin- 
spin correlation function averaging over this configuration set, it shows an algebraic decay with 
the distance, rather than an exponential behaviour, which denotes that the ground state at 
T = is critical. Following from calculations of Stephenson [256] the spin-pair correlation is 
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2 3 12 



Figure 8.1: Demonstration of the triangular Ising antiferromagnet. The spins in different states are lo- 
cated at the lattice sites and signed by filled or empty circles. The triangular lattice can be decomposed 
to three sublattices of non-neighbouring vertices, denoted here by numbers. The defects of different 
sign (green or blue triangles) are induced on a plaquette by three neighbouring spins at a common 
state. The loose spins which flip without changing the energy are signed by a red ring around. 



described by the form along the three major axes as: 



(2-kt 

where r\ = 1/2. However the lattice can be divided into three equivalent sublattices of non- 



r e9 (r)~r-"cos( — ) (8.2) 



neighbouring spins as we demonstrated on Fig 8.1 Within a sublattice the equilibrium corre 



lation function has a clear singular behaviour as T eq (r) ~ r~'' with the same exponent and in 
agreement with Eq |2.9| since the d spatial dimension is two. 

Let us remark that it is possible to choose an appropriate boundary shape where the system 
can have only one ground state and it becomes not degenerated [264]. This special behavior 
arises for parallelogram shape geometries with free boundary condition, however a lattices with 
periodical boundary conditions, what we use during our studies, do not induce this special 
feature. 

If we include a sufficiently small external field H <g; J then the configuration space keeps 
equilibrated. However, by increasing H at the range H ~ J the external field becomes dominant 
and then some ordered states turn to be more favorable and long-range order evolves in the 
system. 

In zero temperature limit in order to define dynamics, we can let the external field to scale with 
the temperature as h = H/T thus when we consider the T — > and H —> limit h remains finite, 
while the nearest- neighbour couplings does not, J/T — > — oo [259]. It was originally suspected 
that the reduced field h is relevant so the system would immediately enter the ordered phase 
when ft ^ however it was not supported by some later analysis [265]. It turned out the 
the antiferromagnetic triangular Ising model is exactly mapped to the triangular solid-on-solid 
model describing the equilibrium shape of a (1, 1, 1) surface of a cubic crystal [257, 259]. Due 
to this mapping one can express the so-called height-height correlation function of the solid-on- 
solid model in terms of Ising correlation. Following from a non-exact renormalization mapping 
of Nicnhuis [266] this correlation has the same asymptotic behaviour as the discrete Gaussian 
model and the lattice Coulomb gas model. Using these mappings the critical behaviour of 
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the model in equilibrium was found to be formally equivalent to the one of XY model which 
maps exactly to the Gaussian model [265] and has a Kosterlitz-Thouless phase transition [260]. 
Consequently the same type of critical behaviour would be expected for the triangular Ising 
antifcrromagnct also. 

Figure 8.2: Phase diagram of 
the two dimensional triangu- 
lar Ising antiferromagnet. The 
system at T = for weak ex- 
ternal field is in a critical phase 
and pass through a Kosterlitz- 
Thouless phase transition at 
h = h K T- If T > 0, the short- 
range order and the long-range 
order phase are separated by 
a three-state Potts critical line 
which saturates at T = to the 
hKT phase transition point. 



The phase diagram of the model is shown in Fig |8.2| At zero temperature and zero field, 
no long-range order arises in the system at least in the isotropic case [267], but we are at 
the critical phase since the correlation function has an algebraic decay (see above). Moving 
on the T = line, if we introduce a weak external field h, at a finite hKT value the system 
undergoes the expected Kosterlitz-Thouless phase transition of infinite order [260] and arrives 
to the long-range order phase, where the residual entropy vanishes out. Here the so-called loose 
spins (that can flip without changing the energy) are condensed on one of the three sublattices, 
and directed by the external field. The resulting ordered state has spin of one sign on two 
of three sublattice and spins of the opposite sign on the third sublattice [259] . Consequently 
this state is threefold degenerated only. For T > at zero field the system does not have any 
phase transition and it is in its short-range order phase where the correlation function shows 
exponential decay. For temperatures larger than zero the long and short-range order phases 
are separated by a critical three state Potts line which arrives to the hKT point at T = [267] . 
The critical point is located at hKT = 0.266(10) which comes from means of transfer matrix 
calculations and phenomenological renormalization [258]. Following from these calculations, at 
the critical phase T — along the critical line < h < h c some exponents were found to be 
constant, whereas others are /i-dependent. 

A general method to classify the ground states of the triangular Ising antiferromagnet in 
equilibrium at the criticality is to map each ground state to its corresponding dimer configura- 
tion [268] . Such a configuration is composed by strings of a dimer which can be established as 
a projection of the dual lattice of the given and a standard ground state configuration. These 
strings cannot intersect each other and their density can rank the different ground states into 
different density sectors. The string density is conserved during the time evolution of a ground 
state, consequently a ground state belonging to a certain sector cannot evolve into another 
ground state of a different density sector. In this sense, the dynamics within the ground state 
manifold is nonergodic, but for each sector with nonzero string density it is ergodic within the 
sector itself. The maximum of the residual entropy density in Eq |8.1| belongs to the density value 
2/3 that defines the so-called dominant sector which contains the most ground states [263,268]. 
This sector plays a special role in case of non-equilibrium dynamics what we discuss in the next 
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section. 



8.3 Dynamical behaviour 

In Section [2.2.6| we already mentioned that a system that we initiate from a disordered state 
at time t = 0, passes through a non-equilibrium relaxation toward its equilibrium phase. In 
an intermediate state during this relaxation the non-equilibrium two-point correlation function 



(defined as Eq 2.8 1 has the form 



r(r,t)~r-( d - 2 -">/(^) (8.3) 

where d is the spatial dimension and r\ is the equilibrium correlation exponent. This scaling 
form holds for arbitrary ratio of r/£(i) if r, £(t) 3> a where a is the lattice constant. Moreover 
the first term of Eq |8.3| gives back the equilibrium correlation function as it is expected in the 
time limit t — > oo when /(0) = 1. 



The length in Eq 8.3 is not the equilibrium correlation length which evolves during 
coarse-graining processes since here it is time dependent. During the non-equilibrium dynamics 
some correlation arises between the originally uncorrelated spins which induces dynamically 
increasing correlated domains in the system. We introduce here £(t) as a time dependent 
length scale to characterize the size of these domains during the relaxation process. This length 
scales as £ ~ t x l z for large t with the same usual exponent z which characterizes temporal 



correlation in equilibrium (see Section 2.2.61. Consequently this exponent z keeps independent 



of the non-equilibrium initial state which can affect only the function f(r /£(£)). 

8.3.1 Non-equilibrium relaxation 

Following from earlier results found in the literature, the non-equilibrium dynamical be- 
haviour of frustrated systems and related models has many interesting features. The fact that 
the dynamics depend on the initial state wherefrom the system was started is a very important 
character. This initial state dependence was observed for the XY model [269-271] which has 
the same critical behaviour than the triangular Ising antifcrromagnet as we have seen earlier in 



Section 2.3.4 The dynamical behaviour is different if we start from a defect-free state where 



the growing length scale satisfies Eq 2.41 with z = 2. On the other hand if the system is started 
from a random initial state and quenched to any temperature between < T < Tkt (where 
Tkt being its Kosterlitz-Thouless critical temperature) the growing length scale exhibits a dif- 
fusive growth during the non-equilibrium relaxation which is slowed down with a logarithmic 
factor as 



with the same z exponent value [269-272]. 

An initial state dependence has been found for the triangular Ising antiferromagnet also. If 
the initial state is a ground state which belongs to a certain sector (see above) then the system 
is driven by only loose spin fluctuations and cannot pass to another sector. These ground state 



dynamics induce a growing correlation length scale which is expected to satisfy Eq 2.41 with 
the equilibrium dynamical exponent z. However if we start the system from a random initial 
state it spontaneously evolves into the dominant sector with string density of 2/3 [263]. In this 
case at the disordered initial state many defects take place in the system (see Fig |8.1| . If we 
quench the magnet to T c — 0, first it passes through a non-equilibrium aging regime where the 
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defects are moving by loose spin fluctuations and vanish out of the system by pair annihilation. 
When the pit) defect density relaxes to zero, the system there reaches its energy minima, which 
after the ground state dynamics govern the system toward the equilibrium state. 

There are different points of view in the literature about the zero temperature dynamics in 
the aging regime of the system. First it was studied by Moore et.al. [261] in absence of external 
field, who recognized an entropy-driven Coulomb force acting between the topological defects of 
opposite sign. They found that the defect density is evolving as pit) ~ ln(i) jt with logarithmic 
correction, expected from the dynamical behaviour of the XY model. 

However this result is not supported by some numerical simulations of Kim et.al. [262, 263] 
who questioned the propositions of Moore. According to them, other degrees of freedom are 
important during the out of equilibrium dynamical evolution since they found a random walk 
like defect motion moving in certain directions governed only by loose spin fluctuations. They 
did not see logarithmic correction of the defect densities but they found a subdiffusive and a 
diffusive growth of the correlation length of the form of Eq 2.41 with different exponent in case 
of the two initial states. They located an exponent z e g ~ 2.33 during the aging regime when 
they started the system from a disordered initial state, and z = 2 for diffusive growth, after the 
system had relaxed to its energy minima state and entered the dominant sector of the ground 
state manifold. 

Another model was investigated by Walter and Chatelain [50] , who examined the fully frus- 
trated Ising model. This system belongs to the same static universality class as the triangular 
Ising antiferromagnet. Consequently the same asymptotic behaviour was expected for the two 
models. They observed the same subdiffusive behaviour with effective z e g exponent as Kim 
et.al at the pre-asymptotic range before the system reaches the aging regime. However at the 
aging regime in agreement with the XY model they found the diffusive description to describe 
better the asymptotic behaviour with logarithmic correction and z = 2. 

According to the previous studies the out-of-equilibrium critical behaviour of the triangu- 
lar Ising antiferromagnet is not fully settled. In the present study we investigate the non- 
equilibrium dynamical behaviour of this model at T c = in the aging regime. However our 
study is irrespective to the earlier methods and our goal is to find independent evidences of one 
of the above presented opposite descriptions. All the previous results deduced the dynamical 
exponent z through some exponent combinations, or the results were dependent on the choice 
of some parameter like the waiting time of the autocorrelation. Here we allocate the dynam- 
ical exponent in a direct way by measuring a quantity which depends only on the exponent 
z. Another feature of our study is that for the triangular Ising antiferromagnet we consider 
not only the zero field model, but the Kosterlitz-Thouless transition at h = Hkt as well. We 
compare the numerical results in the two cases in order to decide if the two transitions are in the 
same dynamical universality class. We executed long-time numerical calculations to examine 
the non-equilibrium relaxation and the autocorrelation function scaling in equilibrium and in 
the aging regime also. 



8.4 Measurements of the dynamical exponent 

8.4.1 Microscopic dynamical rules 

In the performed Monte Carlo simulations we used random update rules. The dynamics of 
the Ising antiferromagnet are governed by a modified Glauber dynamics where the new state 
of a chosen spin i is irrespective to its current value and takes its new state according to the 
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probabilities given by: 

e 0JT.i"i+h e -PJT.i«i-h 

where we choose J < since the system is antiferromagnctic and the summation runs over the 
(Ti neighbours of the current spin i. In the given limit when T — > and (3 J — > 0, the time 
evolution is defined by the Alg|9] Using this zero temperature dynamics, only spin-flips which 
do not increase the system energy are accepted, so AE ^ 0. Let us denote that at zero field in 
case of loose spins with J^. <x; = 0, the flip probabilities become P(|) = P(4) = 1/2. 



Algorithm 9 ZcroTcmperaturcDynamics(iattjce,A r ,A^MCS,' 1 ) 

1: for 1 to Nmcs do 

2: for 1 to N do 

3: Choose a spin i randomly 

4: ^ J2i °i > then 

5: align the spin down 

6: else if J^i °j < then 

7: align the spin up 

8: else if G i = then 

9: align the spin using the probabilities P(f , I) = e hf e -h 

10: end if 

11: end for 

12: end for 



8.4.2 Sample dependent relaxation time 

To determine the dynamical exponent z in the aging regime we need to define a quantity 
which clearly depends only on this exponent. An appropriate quantity is the non-equilibrium 
relaxation time t r which characterizes the size of the aging regime and that we define like the 
time when the system reaches its energy minima after it was started from a disordered initial 
state. When t < t r we are in the aging regime and the system is governed by non-equilibrium 
relaxations, however when t ^ t r the defect density becomes p{t) = and the system evolves 
into a ground state. This relaxation time depends on the system size since it measures the time 
when £(£), the time dependent characteristic length scale becomes £(t r ) = L. If we calculate 
the distribution of t r over different disordered samples with size L, it is expected to hold an 
exponential form as: 

P L (t r ) oc e-^W (8.6) 
where t(L) is defined as the size dependent characteristic time. As we have seen in Section 



2.2.6 and following from numerical observations this characteristic time goes as: 

n(L) ~ L z (8.7) 
consequently an effective exponent can be recognized as t(2L) /t(L) = 2 Ze # . 



On the other hand theoretical consideration (derived from 8.4 1 suggest an asymptotic be- 
haviour as 

r 2 (L)~mnf±-\ (8.8) 



103 



NON-EQUILIBRIUM DYNAMICS OF TRIANGULAR ANTIFERROMAGNETIC ISING MODEL AT T = 



which leads to the form r(2L)/r(L) = 2 z ln(2L/L )/ln(L/L ) where L is an 0(1) constant, . 
Confront the two case the effective dynamical exponent can be deduced of the form: 

To numerically verify these results we made high performance computing to calculate the 
distribution of the relaxation time t r for different system sizes L. We started each sample 
from a random initial state and measure the time when the system energy reached its possible 
minima value E min — — L 2 . 




40000 80000 120000 160000 

t 



Figure 8.3: The P(t r < t) distribution of the relaxation time t r of a system with linear size L = 192. The 
distribution contains data of 90000 independent realizations. The tail of the distribution (t > 40000) 
has an excellent fit with an exponential curve (black line) which is presented in the inset on a lin-log 
scale also. 



We investigated the model on lattices with periodical boundary conditions with linear sizes 
between 33 and 768. The averages were computed over large number of random samples between 
2000 to 200000 depends on the current system size. 

In order to estimate the effective z exponents for different sizes, first we calculated the 
characteristic time t(L) as the average relaxation time t(L) — (t r (L)) over all samples of a 
given size. In the following we are going to use this definition but let us denote that r(L) can 
be derived from the fitting of the tail of the P(t r < t) distribution, which gives an analogous 
result. To evaluate the effective values of the dynamical exponent we used the expression 

ln(t r (L)) -ln(U(L')) 
Zeff{L) ~ HL)-ln(U) (8 ' 10) 

which comes straightforward form the previous methods and we found the values presented in 
Table IO 
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ATIM(if = 


,0) 


ATIM(# = 


Hkt) 


L 


log 2 (t r ) 


Z eff 


samples 


log 2 (t r ) 


Z eff 


samples 


33 


8.80 


2.38 


200000 








48 


10.09 


2.33 


200000 


10.17 


2.35 


200000 


96 


12.42 


2.29 


200000 


12.52 


2.29 


200000 


192 


14.71 


2.24 


89848 


14.81 


2.25 


103799 


384 


16.95 


2.15 


35271 


17.06 


2.13 


38414 


768 


19.10 




1667 


19.19 




1701 



Table 8.1: Average of the sample dependent relaxation time (t r ) for different finite systems of the 
triangular antiferromagnetic Ising model at zero field and at the field induced Kosterlitz-Thouless 
transition point, H — Hkt- The effective dynamical exponent calculated from two consecutive sizes, 



see Eq.( 8.101 is also indicated together with the number of samples used in the simulation. 



To examine the asymptotic behaviour of the characteristic time and find the real dynamical 
exponent we fitted function of two forms defined in |8.7| and |8.8| on the calculated numerical 
values. We tried to find the best fit of this two functions, t^L), to the numerical averages 
(t(L)) by minimizing their deviation from the numerical values of different sizes as: 



mm< 



L=33,48,96,192,384,768 



n 



i(L) - (r(L)> 



11) 



i(L) + (r(L)) 

with given parameters z, Lq and a constant factor A. In zero field the best parameter set were 
found a,s: 



n(L) = 0.18L 226 (8.12) 
t 2 (L) = 0.183L 2 li/^J (8.13) 



The Fig 8.4 presents the two analytical curve fitting on numerical values. It is well seen that 
the function with logarithmic correction and exponent z = 2 has much better fit. We denote that 
the value z = 2 in Eq |8.13| was not imposed but found directly, performing an accurate scan on 
the parameter set z, L and A. It is possible since the number of fitted points is not too large. 
The function to minimize shows is slowly varying in the range [1.96,2.04] with a minimum 
located precisely at z = 2, outside this range, it is rapidly varying. It is also shown that 
measurements with large size are needed to discriminate the two asymptotic behavior. We tried 
to extrapolate the dynamical exponent z, via the calculated effective values using the scaling 
z e ff(L) ~ l/ln(L/Lo) and we also found the asymptotic value z — 2. Repeating this analysis in 
case of h = h KT external field the best fits are n (£) = 0.18L 228 and t 2 (L) = 0.20L 2 ln(L/3.9), 
and again the logarithmically corrected scaling variable provides a better fit to the numerical 
values. In both cases the relative error of the fits were 5 to 10-times smaller for the second 
scenario. 

Following from these considerations we can proposed that the dynamics in the aging regime 
has a diffusive behaviour with exponent z = 2 and logarithmic correction rather than some 
subdiffusivc growth characterizes the system even at zero field and at the critical external field 
h = h KT . 
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Figure 8.4: Fitting of the size dependent average characteristic time (t(L)) with the curves defined 
in Eq |8.7| and Eq |8.8| The best parameters are in Eq |8.12| and Eq |8.13| respectively. This calculation 
gives an evidence that the triangular Ising antiferromagnet has a diffusive dynamical behavior with 
logarithmic correction. The estimated error are smaller than character size. In the inset extrapolation 
of the effective dynamical exponents in Table 8.1 are given as a function of l/ln(L/Lo) with Lo — 2.5. 



8.5 Scaling of the autocorrelation 



As we have seen in Section [2. 2. 6 during the non-equilibrium relaxations, the dynamics can be 



decomposed to two parts (see Eq 2.421 where the two-time autocorrelation A(s,t) after a first 



short-time period becomes a homogeneous function of t/s of the form of Eq 2.43 Following this 
aging regime when the system reaches its equilibrium, the autocorrelation is expected to behave 
as Eq |2.40| In this section we are going to study the autocorrelation function of the triangular 
Ising antiferromagnet in equilibrium and in the aging regime using the method as it was used 
for the fully frustrated Ising model by Walter and Chatelain [50]. We are going to discuss the 
case of zero external field and when a critical field h = h c is applied on the system. First 
we examine the equilibrium case where we deduce the dynamical exponent through exponent 
combination then we study the scaling behaviour in the non-equilibrium regime with linear and 
logarithmic corrected scaling variables. 

8.5.1 Equilibrium scaling 



The scaling behaviour of the two-time autocorrelation function A(s,t) (defined in Eq 2.38) 
has been shortly discussed in Section [2. 2. 6 1 As we saw there, the autocorrelation is invariant 
under time-translation since it depends only on the time difference (t — s) and it is independent 
on the choice of the waiting time s. Moreover due to the divergence of the relaxation time at the 
critical point an algebraic decay of A eq (t, s) is expected of the form A eq (t, s) ~ (t — s)~ ac with 
exponent a c = 2(3/vz where 2f3/v — 1/2 in case of zero field [50,51,263] and it is expected to 
be 2(3 /v = 4/9 [258] in critical external field. This scaling behaviour enables us to estimate the 
dynamical exponent z in an indirect way by calculating the average autocorrelation function in 
equilibrium. 

To examine the equilibrium dynamical behaviour first we needed to evolve the system into 
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Figure 8.5: Autocorrelation in equilibrium with different waiting times s. (a): The data were calculated 
on lattice with linear size L—192 and periodic boundary conditions, average over 1300 equilibrated 
samples. The function has a clear algebraic decay for sufficiently large waiting time (t — s) > 40. The 
asymptotic slope of the curve is given by a(h = 0) = 0.2501(10). (b): the same analysis at ft = Kkt- 
The asymptotic slope of the curve is given by a(h — Kkt) = 0.229(5). 



a homogeneous ground state where only the loose spins fluctuations influence the dynamics. 
To reach this kind of equilibrated states for each sample, we started the system from different 
random initial states, quench it to T — and evaluate it following by the dynamical rules 
defined in Section [8.4.11 After the system reached its energy minima state at time t r we let it 
evolve until t = 1.5 * t r . This time was then defined as the zero time point s = t = for the 
autocorrelation. 

The average autocorrelation function with different waiting times is shown in Fig |8.5| The 
calculations were performed on a lattice with linear size L = 192 and periodic boundary con- 
ditions, averaging over 1300 (1200) samples in zero (critical) field. One can clearly seen that 
A eq (t, s) decays as a power-law for sufficiently large separation time. We used the least squares 
method to fit the sample average of A eq (t, s) for (t — s) > 40, where we did not take in account 
the statistical error of the average calculation. In the absent of ordering field the slope of the 
fitted straight line is -0.250122±4.917e-05 with an offset -0.105929±0.0001742 which suggest 
a very good systematic error. It leads to estimate a c ~ 0.25 and the dynamical exponent z ~ 2 
which is in complete agreement with our previous results in Section[8.4.2| In case of critical field 



the slope is -0.229051 ± 0.0001075 with an offest -0.103873 ± 0.0003036 (see Fig{8J>|) which 
is also close to the conjectured exact value: a c = 2/9 and suggests z ~ 2 for the equilibrium 
dynamical exponent as it is expected. The time-translation invariance is well presented too 
since all the calculated averages collapse together independently from the waiting time s. 

8.5.2 Non-equilibrium scaling 

The autocorrelation function of homogeneous fcrromagnets in the aging regime after a short 
time relaxation (t,s ^> 1) becomes a homogeneous function of t/s and is expected to scale 
as Eq |2.43| [50]. This asymptotic behaviour was found for a large class of different models 
[51,273,274]. However for the XY model the relaxation in the aging regime is slowed down by 
a logarithmic factor and the correlation length grows as Eq 8.4 so the autocorrelation function 
has another scaling variable and scales as: 
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which scaling form have been observed for the fully frustrated Ising model also [50]. 




Figure 8.6: (a): s ac A ag (t, s) ~ t/s and (b): s ac A ag (t, s) ~ tln(s) / sln(t) scaling of the autocorrelation 
function in the aging regime in zero external field. The system size is L = 192, the lattice has periodic 
boundary conditions and the averages were calculated over 3000 realizations. We applied the exponent 
a c — 0.25012 that we considered for equilibrium. 



Here we are going to study the scaling of the autocorrelation function in the aging regime of 

or 



the triangular Ising antiferromagnet to determine which scaling scenario, the one in Eq 2.43 



the other Eq |8.14| is more compatible with the numerical data. In order to do so we search for 
the better collapse of the scaling function s ac A ag (t, s) using the scaling variable t/s or the one 
of £ln(s)/sln(f) with logarithmic correction. In our numerical simulations we chose the same 
lattice conditions as for the equilibrium case and calculated averages over 3000 realizations. 



The numerical results of different waiting times are presented on Fig 8.6 a and Fig |8.6| b with 
respect to the two types of scaling variables. Here we used the exponent a c = 2(3 /vz = 0.25012 
in case of zero field which was determined in the previous section for equilibrium. 



On Fig 8.6 a when we choose the scaling variable for t/s, the autocorrelation functions are not 
collapsed and they scale over by the waiting time s except the curves of s = 640 and s — 1280 
which are closer to each other. This could be a sign of an asymptotic behavior, however we 
need to calculate with much larger waiting time and system size to verify this trend. 

On the other hand when the scaling variables are chosen as fln(s)/sln(£), we find a very 
good collapse if the waiting time was s > 40 (see Fig 8.6 b). Here the difference between the 



scaling curves is in the range of the magnitude of the statistical fluctuations. Since the scaling 
becomes better as we increase the waiting time and the curves present an excellent collapse 
for sufficiently large s, we can take that proposition to be the true asymptotic behaviour. 
Consequently our data are in favour of logarithmic corrections in the scaling function of the 
autocorrelation function at H = 0. We have then estimated the autocorrelation exponent, X/z, 
from the slope of the linear part of Fig |8.6| b for the three largest waiting times and we obtained: 
X/z = 1.003(10). That value corresponds to A = d, as obtained for the fully frustrated Ising 
model [50]. 

The non-equilibrium autocorrelation function at the h — h c Kosterlitz-Thouless phase tran- 
sition point presents the same type of scaling as it was seen in zero external field. Here we used 
the exponent a c = 0.229051 which was determined for in the previous section for equilibrium 
at h = h c . The scaling collapse for different waiting time is much better with logarithmically 
corrected scaling variable. We have also measured the autocorrelation exponent with the result: 
X/z — 0.93(2), what is somewhat smaller than those found in the other case. 

As a conclusion we can point out that the the similar rules govern the dynamics of the 
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triangular Ising antifcrromagnet at its criticallity as the XY model and supports the assumption 
of dynamics with logarithmic correction. Let us denote that the same asymptotic behavior was 
found for the fully frustrated Ising model [50] also, which suggests that beyond the two models 
belong to the same static universality class, their dynamical behavior is similar too. 




Figure 8.7: (a): s a " A ag (t, s) ~ t/s and (b): s a " A ag (t, s) ~ tln(s) / sln(t) scaling of the autocorrelation 
function in the aging regime in h — h c external field. The system size is L — 192, the lattice has 
periodic boundary conditions and the averages were calculated over 5000 realizations. We applied the 
exponent a c — 0.229051 that we considered for equilibrium. 



8.6 Summary 

In this chapter we studied the dynamical behaviour of the antiferromagnetic Ising model 
on triangular lattice at zero and field and at the h = h c Kosterlitz-Thouless phase transition 
point. We used zero temperature Glauber dynamics to perform long-time running computer 
simulations in order to calculate numerical averages. 

Our aim was to choose the relevant description between the one of Moore et.al. [261] who saw 
a non-equilibrium relaxation slowered by a logarithmic factor or the one of Kim et.al [262,263] 
who believed that the relaxation dynamics were governed by subdiffusive scalings with an 
effective exponents z — 2.33. 

In order to do so, we defined a new measurable quantity, the t r relaxation time, which scales 
clearly with the dynamical exponent z and characterizes the length of the aging regime. From 
its distribution we could conclude that the non-equilibrium dynamics of the triangular Ising 
antiferromagnet in the aging regime presents an analogous behaviour as the XY model. 

Using this result we can estimate the asymptotic behaviour of the density of defects, p(t), in 
the systems. To be concrete we consider the model at h = for which a defect is represented 
by an elementary triangle having all the three spins in the same state. In a finite sample of 
linear size, L, and sample dependent first passage time, t r , at t = t r there is one (or O(l)) 
defect, consequently the density of defects at t = (t r (L)) is p(t) ~ L -2 . Using the relation in 



Eq 8.4 and replacing £ by L we arrive to the result: p(t) ~ log(t/to)/i, in agreement with the 
conjecture in [261]. 

The analogy with the nonequilibrium scaling of the YY-model is found to be valid for the 
autocorrelation function, too. Both at zero field and at h = h c optimal scaling collapse of the 
autocorrelation function is found if the scaling variable is taken in the same form, as in the XY- 
model. At h — as for the FFIM [50], the autocorrelation exponent is found to be A — d, like in 
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mean-field theory, however with logarithmic corrections. On the other hand the field-induced 
Kosterlitz-Thouless transition point the autocorrelation exponent is found somewhat smaller, 
than d. Consequently in the ATIM with varying field the dynamical exponent is presumably 
constant, z = 2, the scaling functions contain same type of logarithmic corrections, but the 
autocorrelation function weakly depends on the value of h. 

The publication of the new scientific results presented in this chapter is in progress [26]. 
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Chapter 9 



Discussion 



In my PhD thesis I studied the cooperative behaviour of complex interacting many body 
systems using the methods of statistical and numerical physics. I completed studies in four 
different subjects and I summarized my new scientific results in the current dissertation as 
follows. 

To outline the relevant scientific background of my work I reviewed the related models and 
theoretical considerations of the subject of phase transitions, universality and critical phenom- 
ena in case of homogeneous and disordered models. I summarized the basic features of network 
science as I defined the important properties of regular graphs and reviewed the main models 
of random networks. I discussed the basic concepts of Monte Carlo techniques and introduced 
the applied numerical methods. After this introductory section I discussed my new scientific 
results in the case of the following investigated problems. 

First I studied non-equilibrium phase transitions in weighted scale-free networks where I 
introduced edge weights and rescaled each of them by a power of the connectivities, thus a 
phase transition could be realized even in realistic networks having a degree exponent 7 < 3. 
The investigated non-equilibrium system was the contact process which is a reaction-diffusion 
model belonging to the universality class of directed percolation. 

I/a : First I gave the dynamical mean-field solution of the model in scale-free networks and I 
located the previously known three critical regimes. The first regime is the one where the 
mean-field behaviour is conventional. Then this solution becomes unconventional since 
critical properties are 7 dependent. In the third regime, the system is always in an active 
phase. 

Tjb : I also made some theoretical considerations to generalize recent field-theoretical results 
about finite-size scaling which are expected to be valid above the upper critical dimension 
i.e. in the conventional mean-field regime. I introduced in a simple way the volume of the 
network into the scaling functions that I derivate for two cases, where the infection was 
initiated from a typical connected site or from the most connected vertex of the network. 

X /c : I executed high performance numerical simulations in order to simulate the contact pro- 
cess in the conventional mean-field regime. I located the phase transition point and I 
calculated the finite-size scaling exponents for typical and maximally connected site that 
I found to be in good agreement with the field-theoretical predictions. I also determined 
the correlated volume exponent which was found equal in the two cases and compatible 
with the theoretical expectations. Finally I analyzed the dynamical scaling of the system 
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at the critical point for the two above mentioned cases. Through extrapolations I consid- 
ered the related exponents to be different in the case of typical and maximally connected 
sites but compatible with the mean-field and finite-size scaling predictions. 

The second problem I investigated was the ferromagnetic random bond Potts model with 
large values of q on evolving scale- free networks. This problem is equivalent to an optimal 
cooperation problem, where the agents try to find an optimal situation where the benefits 
of pair cooperation (here the Potts couplings) and total sum of the support, which is the 
same for all projects (introduced here as the temperature), is maximized. I examined this 
model using a combinatorial optimization algorithm on scale-free Barabasi- Albert networks with 
homogeneous couplings and when the edge weights were independent random values following 
a quasi-continuous distribution with different strength of disorder. 

XX j a : As a first point I gave the exact solution of the system for a wide class of evolving 
networks with homogeneous couplings. The phase transition was found to be strictly 
first-order and the critical point was determined through simple theoretical considerations. 

XX jb : By numerical calculations I examined the magnetization curve for different strength of 
disorder and found the theoretically predicted first-order phase transition in the pure case. 
However, the phase transition softened to a continuous one for any strength of disorder 
larger than zero. I examined the structure of the optimal set and I found out its structural 
behaviour was altered by the temperature. 

XX I c : I studied also the critical properties of the system and I calculated the distribution of the 
finite-size critical temperatures for different sizes in case of maximal disorder. I deduced 
by iterative calculations the critical magnetization exponent and I located the critical 
temperature using two independent methods. The scaling of the finite-size transition 
points distribution was characterized by two distinct exponents, that I located and used 
to consider a scaling collapse of the distribution curves. 

XX I d : I also deduced the critical magnetization exponent by two-point fits using the average 
size of the critical cluster. I obtained compatible values with previous results within the 
error of the calculations. 

The third examined problem was related to the large-g sate random bond Potts model also. 
Here I examined the critical density of clusters which touched a certain border of a perpendicular 
strip like geometry. Following from conformal prediction I expected the same density behavior 
as it was exactly derived for critical percolation in infinite strips. I calculated averages by the 
above mentioned effective combinatorial optimization algorithm and I compared the numerical 
means to the expected theoretical curves. 

XXX /a : During my study I used a bimodal form of disorder for the random couplings, which 
intensity influenced the breaking-up length of the critical clusters. I allocate an appropri- 
ate value of the strength of the disorder which set the breaking up length large enough 
for relevant measurements but small enough to keep away from the percolation limit. 

XXX jb : First, I examined the critical densities of spanning clusters which touch both bound- 
aries along the strip geometry. I found a good agreement between the predicted conformal 
values and the calculated averages of different linear size. I checked the validity of a com- 
bination of the bulk and surface magnetization exponents coming from scaling predictions 
through the study of the density behaviour close to the boundaries and I found reasonable 
accordance. I also applied a correction close to the boundaries in order to obtain a better 
fit between the calculated and predicted curves. 
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222 1 c : Second, I considered the density of the clusters which are touching one boundary of the 
strip. This density is analogous to the order parameter profile in the system with fixed-free 
boundary conditions. This profile close to the fixed boundary was strongly perturbed by 
surface effects, which are due to the presence of the finite breaking up length. However, 
at the free boundaries the density curves approached a scaling curve which sat on the 
predicted conformal function. Close to the fixed boundary I estimated the asymptotic 
behaviour of the scaling curve through extrapolation and I obtained values in agreement 
with the conformal results. 

222 1 d : Finally I considered the density of points in clusters that are touching one of the 
boundaries or both. This density is analogous to the order parameter profile with parallel 
fixed spin boundary conditions. This density profile was found to be strongly perturbed 
by the breaking-up length at both boundaries thus I studied another density which was 
defined on crossing clusters only. However, it was supposed to be related to the same 
operator profile and expected to present the same scaling form. I performed the same 
calculation for percolation also and I found that the numerical and analytical results for 
this type of density profile were in good agreement in both cases. 

The last investigated problem was the antiferromagnetic Ising model on two-dimensional 
triangular lattice at zero temperature in the absence of external field. This model was intensively 
studied during the last few decades, since it shows exotic features in equilibrium due to its 
geometrical frustration. However contradictory explanations were published in the literature 
about its non-equilibrium dynamical behaviour as it was characterized by a diffusive growth 
with logarithmic correction or by a subdiffusivc dynamics with effective exponents. My aim was 
to find independent evidences for one of the explanation and examine the dynamical behavior 
in the aging regime. 

2V/a : To study the non-equilibrium behaviour of the system I introduced a new quantity, 
the non-equilibrium relaxation time t r , which depends only on the dynamics and that is 
capable to determine directly the true value of the dynamical exponent z. The analysis 
of the distribution provided a strong proof for the dynamics in the aging regime to be 
governed by an exponent z — 2 with logarithmic correction as it was found in related 
problems like the two-dimensional XY model and the fully frustrated Ising model. 

2V/b : Following some recent published methods I also studied numerically the two-time auto- 
correlation function in the equilibrium regime with different waiting times, after the sys- 
tem was relaxed into an equilibrated state. Here I found the expected time-translational 
invariant behaviour of the autocorrelation function and I located the same dynamical 
exponent value as above through some exponent combination. 

2V/c : Finally I considered the scaling of the autocorrelation function of different waiting times 
in the aging regime where I used two kind of scaling variables. The one without logarith- 
mic correction did not show a good scaling collapse which suggested that this variable 
choice was inconvenient. However the scaling with a logarithmically corrected variable 
presented an asymptotically good scaling collapse which proved the validity of the loga- 
rithmic corrections during the non-equilibrium dynamics in agreement with the previous 
considerations. 

As a summary of my considerations that I obtained during my PhD work and reviewed above 
in the current thesis, I can declare that I completed studies of recent physical problems in order 
to describe cooperative behaviour in complex systems. My motivation was to give a relevant 



113 



DISCUSSION 



description of the related models and complete our knowledge about this segment of science. 
The validity of my results will be judged in the future as it may become an adaptable description 
of Nature. 
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Appendix A 

Equivalence between the Potts 
model and the random-cluster 
model through conditional 
measures 



Here we are going to discuss an alternative method to see the equivalence between the g-state 
Potts model and the random cluster model. In order to do so we use the notation introduced 
in Scction l2lT2l 

When q G Z is an integer, the random- cluster measure (RC measure), defined in Section 
2.3.2 corresponds to a Potts measure ^^(cr) in the absence of external field hi = on the 



sample space E. Let q > 2 and take the sample space £ = {1,2, ...,q} thus assign any of q 
state to each vertex in V . Now the relevant probability measure is given by: 



-0H(tr) 



where 



cr G £ 



(A.l) 



with Ti and Z were defined as in Eq 2.45 and Eq 2.46 Hereafter if we construct the two systems 
on the same probability space we can observe their relationship through their realizations using 
essentially combinatorial methods [275,276]. We consider a product sample space £ x f2, where 
E = {1,2, ...,q} , ft = {0,1} and let q G {2,3,...}, < p < 1 and measure on a finite 
graph G = (V, E) as before. Now we define a probability mass function fi(a, uS) of the coupled 
measurement on E x O 

M(a,cj)oc Y[{(l-p)5(u(e),0)+pS(u(e),l)5 e (a i ,a j )}, ((T,w)eExS] (A.2) 

where 8 e {oi,aj) = 5{oi,Oj) for the edge e = G E. 

In a conditional measure if firstly to is given, a selection on S is obtained by choos- 

ing uniformly distributed random spins for the c(ui) number of connecting component (see 
Fig A.l a). These spins are constant on a given cluster and are independent between clusters. 
On the contrary if a is given firstly, the conditional measure /i(-|cr) on f2 is obtained by choosing 
edges uj(e) = 1 with probability p if 5 e {oi,Oj) = 1 (independently between edges), otherwise 
set uj{e) = (see Fig|A.l|b). 
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1 



V 

- -f 




Figure A.l: Illustration of the conditional measure of fi(cr,uj) with q = 4. On the figure a. when 
we choose uniformly a spin value from {1, 2, 3, 4} independently for each cluster of ui. On the contrary 
case, when /i(-ja), we begin with a configuration a and attach two neighbouring spins i and j with 
probability p if Oi — (jj otherwise let them disjoint. 



Consequently the probability mass function // is a coupling between the RC measure 4>p,q{u) 
on and the Potts measure "Kp^^ia) on S, and the parameters are related by p = 1 — . 
At the thermodynamical limit, the phase transition of a Potts model corresponds to a creation 
of an infinite size cluster in RC model. This special coupling may be used to understand the 
correlation of the Potts model in a particular simple way at its criticality. 
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Appendix B 

The continuum and the 
master-equation approach of 
Barabasi- Albert model 



Here we are going to discuss shortly the relevant solutions of the Barabasi-Albert model. The 
two presented methods were published by Barabasi and Albert [15, 125] and by Dorogovtsev 
et.al. [126,127] and Krapivsky et.al. [128]. Here we are going to use the notations of Section 



B.l Continuum approach 

Barabasi and Albert calculated the time evolution of the degree fe« of a given node i in the 
network following the next considerations [15,16,125]. 

At each time step when we add a new point to the network with m edges, ki is increasing 
with the probability Tl(ki). Suppose that ki is a real continuous variable and evolving by the 
dynamical equation: 

dki . . ki 

— = mn(k z ) = m— w=1 

dt E i= i k J 



mU(ki) = m ^ A ,_ 1 — (B.l) 
kj 

N-l 



where the sum goes through all nodes except the new added vertex with m edges. So Y]j—i kj — 
2mt — m and the dynamical equation changes as: 

d kj kj kj kj _ _ . 

— - = m- -— = — ~ — if t > 1 B.2 

dt (2t - l)m 2t - 1 2t y ' 

If we keep the condition that each node i has a degree ki{t{) = m at the time tj when it is 
added to the network, the solution of this equation arises as: 

tV . - i 



h(t) = m 1 — 1 where = - (B.3) 

Consequently the degree of every nodes evolves following a power-law. The probability that 
P(ki(t) < k) is: 

P(h{t) <k) = P(m (~) ^ <k) — Pim 1 ^ (~) < k 1 ^) = Pfa > (B.4) 
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Suppose that the nodes were added to the network with equal time difference, and ti has 
a constant probability density: P(U) — 1/too + t where too is the initial network size. By 
substituting it to Eq|B.4| we get: 



m 1 /^, , to 1 /^, m 1/f3 t 

P ^ > W } = 1 - P ^ * W } - 1 - WHn^t) (R5) 

Finally after a derivation we can write the degree distribution in the following way: 

dP{kAt)<k) m l 'H 1 m 1 /' 3 , . 

m = dk = p(m + t) wim whlch s° esas p W~pj&m ( B - 6 ) 

if t — » oo. Since f3 = h, the degree distribution can be written as P(k) ~ 2m 2 fc ~ 7 , where 
7=^ + 1 = 3 is independent of m. It is demonstrated in the inset of Figure 3.6 where the 
rescaled degree distribution with different to fits well on a power-law function with the expected 
exponent. 



B.2 Master equation approach 

The method of Dorogovtsev, Mendes and Samukhin [126, 127] studies the time evolution of 
Pk fraction of nodes with degree k. The probability that a new edge linking to a node which has 
k neighbors is ^ kp , k — — . Here the denominator is the mean degree of the network, equal 

k Pk 2m toil 

to kpf. — 2m since every new node introduces to undirected edges and increases with 2to 
the total degrees of nodes [100]. Now the mean number of nodes with degree k which receive 
an edge when a new nodes is added is m-f^ = \kpk independent of to. 

Following the master equation treatment, the Npk number of nodes with degree k increases 
with the number of vertices which had k — 1 neighbors before, but received a new edge in the 
given step N — * N + 1 . However Np^ decreases with the number of such nodes which had k 
degree, but also attached to an edge and has k + 1 neighbours after. So the number of nodes 
with degree k changes when we add a new node with to edges and the size increases from N to 
N+ 1: 

(N + l)p k ^ N+1 - Np ktN = -{k - l)pk-\,N - 7^kp kyN when k > to (B.7) 

where Pk n denotes the probability p k , when the system size is N. When k = to, the number 
of nodes which increase Np m is equal to 1, the new added node only, since there is no vertex 
with degree k < to, so: 

(N + l)p m ,N+i ~ Np mtN = 1 - ^mp„ hN when k = to (B.8) 
Finally give the stationary solution when p k ,N = Pk.N+i = Pk'- 



p(k) = | \ 



\{k- - \kp k if k > m 

\mp m if k = to 



Rearranging for p k we get a self consistent solution [126, 128] for p k : 

**» ^ W < B " 9 > 

which follows a power law p{k) — P{k) — k 1 in the limit k 3> to with a fixed exponent 7 = 3. 

The rate equation approach of Krapivsky et.al. [128] is completely equivalent with the above 
discussed solution but applies the dynamical master equation treatment on the average number 
of nodes with degree k at time t. 
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Summary 



In this PhD thesis I investigated cooperative behaviour in various type of complex many body 
systems which were applied on scale-free graphs and regular structures. I interested in their 
static and dynamic critical behaviour in the vicinity of their phase transition point. I completed 
high performance computations using recent numerical methods in order to characterize their 
critical properties through numerical averages. Here, following a short introduction to the 
subject, I shortly review my main results what I developed in four different subjects. 

Cooperative phenomena is an ordinary pattern in various part of science where interacting 
entities attempt to satisfy some optimal conditions. Such kind of behaviour is observable in 
sociology, economy, biology or physics etc., where the correlative agents are defined differently 
but their behaviour presents universal attributes. In this sense the complexity of a system can 
be defined by its interconnected features arising from properties of its individual parts. Such 
parts could be either which govern the interactions or the dynamical rules to control the time 
evolution or the backgrounding structure which also can influence the system behaviour. This 
kind of combined effects leads to a complex system with non-trivial cooperative behaviour and 
brings on many interesting questions which give the motivation for advanced studies. 

Correlated systems can be examined efficiently within the frame of statistical physics. The 
subject of this area is to study systems which depend on random variable, and describe their 
behaviour obtained from large number of observation using physical terminology. An interesting 
subject of this segment is the one of phase transitions which has been intensively studied since 
the beginning of the 20th century. Phase transitions occur in many part of Nature where 
counteractive processes compete to determine the state of the system controlled by an external 
parameter. The best-known examples in physics are the liquid-vapor or the ferromagnetic- 
paramagnetic phase transitions but similar behaviour can be observed in model systems like in 
different spin models, in epidemic spreading problems or in critical percolation. 

The first relevant approach was the mean field theory which gave a phenomenological de- 
scription of phase transitions and critical phenomena and is capable to describe a wide range 
of model systems. It was first defined by Pierre Weiss in 1907 for ferromagnetic systems where 
he assumed that the spins interact with another through a molecular field, proportional to the 
average magnetization [1]. This molecular field approximation method neglects the interactions 
between particles and replaces them with an effective average field which enables to simplify the 
solution of the problem. At the same time the disadvantage of the method originates from the 
average molecular field also, since it neglects any kind of fluctuations in the system. Therefore 
the mean field approximation is valid only in higher dimensional systems or in case of models 
where the fluctuations are not important. 

One of the simplest and most elegant mean field speculations concerning the possible general 
form of a thcrmodynamical potential near to the critical point was introduced later by Lev. D. 
Landau [2,3] in 1936. The Landau theory allows a phenomenological reproduction of continuous 
phase transitions based on the symmetry of the order parameter. He assumed that the free 
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energy can be expanded as a power series of the order parameter where the only terms which 
contribute are the ones compatible with the symmetry of the system. 

The observation that the correlation length diverges at the phase transition point and the 
fluctuations in the system are self-similar in every length scale, led to the recognition of scale 
invariant behaviour of critical systems. The first comprehensive mathematical approach of 
such phenomena was given by Leo Kadanoff in the 1960s [4,5]. A few years later in the 
beginning of the 1970s based on his results, Kenneth G. Wilson gave the relevant discussion 
of the subject in his celebrated papers [6,7]. He introduced the renormalization group theory 
which serves predictions about critical behaviour in agreement with experimental results and 
give a possibility to categorize critical systems into universality classes due to them singular 
behaviour. His investigations were awarded with a Nobel prize in 1982. 

In the beginning of the 1970s another theory emerged which completed the knowledge about 
the universal behaviour around the criticality. The conformal field theory was firstly investigated 
by Polyakov [8] , who capitalized that the group of conformal mappings is equivalent to the group 
of complex analytical functions in two dimensions [9, 10]. Exploiting this property and the scale 
invariant behaviour, the partition function of a critical system is derivable which leads to exact 
calculations of critical exponents. In the case of conform transformations the order parameter 
correlation functions can be calculated also which then enables to deduce the order parameter 
profiles along the system boundaries. 

As a first approximation generally the investigated system is assumed to be homogeneous, 
which condition simplifies its study and the physical description. However, in Nature a sub- 
stance is often characterized by certain degree of inhomogeneity which could perturb its critical 
behaviour [11]. Frequently stated examples of this abnormality, are the lattice defects and im- 
purities in crystals. In theoretical description this kind of feature is introduced by the concept 
of disorder which is defined as random distributed values of certain properties of the investi- 
gated disordered model. These random properties can be the strength of interaction, a random 
external field or can arises by random dilution. These properties are able to modify the critical 
features of the system as changing the order of phase transition or shift the critical point and 
exponents, thus transforming the model into a new universality class. 

However, inhomogeneity can arise from the geometrical structure of the backgrounding frame- 
work of materials also. Beyond solid-state physics where crystals have a regular geometry, 
many self-organizing media in the Nature can form random structures. Two Hungarian math- 
ematicians, Pal Erdos and Alfred Rcnyi defined the first related random graph model in their 
pioneering papers [12-14] in the beginning of the 1960s which was the origin of the new sci- 
ence of networks. However, as the informations of real world networks became available by 
the emergence of large databases, a deeper view into the underlying organizing principles sug- 
gested a more complex structure. In the beginning of the 1990s Barabasi, Albert and Jcong 
after they examined the structure of the World Wide Web found an algebraic decay of the 
network degree distribution. This observation made them realize the real rules which govern 
the evolution of such kind of complex networks. They defined a dynamical growing network 
model, the Barabasi- Albert model [15], where the sites are not connected homogeneously but 
follow a so-called preferential attachment rule leading to a scale-free graph with a power-law 
degree distribution. This model gave a very good approximation of real complex networks and 
became popular after many complex systems in science and technology were found to present 
the same structure [16]. This interdisciplinary behaviour which suggests universal rules behind 
self-organizing networks keeps this discipline to the frontline of science up to this day. 

Analyzing a complex many body system was difficult earlier since generally these systems 
have large degrees of freedom and those could be in many possible states. However, by the 
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improvement of computational engines new possibilities appeared and high precision numerical 
methods were developed to examine the relevant models. It was the base of the new discipline 
of numerical physics which then became the third pillar of the science beyond the experiments 
and theory. By using numerical calculations, the statistical description of many body systems 
became available which then led to a renaissance of the statistical physics. This relation induced 
the evaluation of Monte Carlo methods which provided special computational techniques for 
statistical physics simulations. 

One of the first and most frequently used method which is capable to simulate interacting 
spin systems is the Metropolis algorithm, introduced in 1953 [17]. This so-called single spin 
flip algorithm evaluate the system through a Markov chain where the system energy change 
depends on local configurations. However, some other algorithms of Swendsen-Wang [18] and 
Wolff [19] provided more efficient methods where instead of one-by-one spin flips, complete 
domains are turned in one step and evaluate the system faster toward its equilibrium. 

Beyond that, many other kind of statistical methods were developed in order to calculate 
some thermodynamical function using mathematical considerations. A recent algorithm which 
capitalize combinatorial optimization is capable to calculate exactly the free energy for models 
where the free energy function can be recognized as a submodular function [20,21]. This iterative 
method which provided results in strongly polynomial time was applied frequently in course of 
my work. 

My motivation during my PhD studies was to examine cooperative behaviour in complex 
systems using the previously mentioned methods of statistical and computational physics. The 
aim of my work was to study the critical behaviour of interacting many-body systems during 
their phase transitions and describe their universal features analytically and by means of nu- 
merical calculations. In order to do so I completed studies in four different subjects which are 
presented in the dissertation as follows: 

After a short introduction I summarized the capital points of the related theoretical results. 
I shortly discussed the subjects of phase transitions and critical phenomena and briefly wrote 
about the theory of universality classes and critical exponents. Then I introduced the important 
statistical models which were examined later in the thesis and I gave a short description of 
disordered models. In the next chapter first, I pointed out the definitions of graph theory that 
I needed to introduce the applied geometrical structures and I reviewed the main properties of 
regular lattices and defined their general used boundary conditions. I closed this chapter with 
a short introduction to complex networks. The next chapter contains the applied numerical 
methods that I used in the course of numerical studies. I write a few words about Monte 
Carlo methods and introduce a combinatorial optimization algorithm and its mathematical 
background. As a last point I describe my own techniques to generate scale-free networks. 

Following this theoretical introduction the obtained scientific results were presented in the 
following way: 

My first investigated subject was a study of non-equilibrium phase transitions in weighted 
scale-free networks where I introduced edge weights and rescaled each of them by a power of 
the connectivities, thus a phase transition could be realized even in realistic networks having a 
degree exponent 7 < 3 [23]. The investigated non-equilibrium system was the contact process 
which is a reaction-diffusion model belonging to the universality class of directed percolation. 
This epidemic spreading model presents a phase transition between an infected and a recovered 
state ordered by the ration of the recovering and infecting probability. 

I/a : First I gave the dynamical mean-field solution of the model in scale- free networks and I 
located the previously known three critical regimes. The first regime is the one where the 
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mean-field behaviour is conventional. Then this solution becomes unconventional since 
critical properties are 7 dependent. In the third regime, the system is always in an active 
phase. 

X/b : I also made some theoretical considerations to generalize recent field-theoretical results 
about finite-size scaling which are expected to be valid above the upper critical dimension 
i.e. in the conventional mean-field regime. I introduced in a simple way the volume of the 
network into the scaling functions that I derivate for two cases, where the infection was 
initiated from a typical connected site or from the most connected vertex of the network. 

X/c : I executed high performance numerical simulations in order to simulate the contact pro- 
cess in the conventional mean-field regime. I located the phase transition point and I 
calculated the finite-size scaling exponents for typical and maximally connected site that 
I found to be in good agreement with the field-theoretical predictions. I also determined 
the correlated volume exponent which was found equal in the two cases and compatible 
with the theoretical expectations. Finally I analyzed the dynamical scaling of the system 
at the critical point for the two above mentioned cases. Through extrapolations I consid- 
ered the related exponents to be different in the case of typical and maximally connected 
sites but compatible with the mean-field and finite-size scaling predictions. 

The second problem I investigated was the ferromagnetic random bond Potts model with 
large values of q on evolving scale-free networks [24] . This problem is equivalent to an optimal 
cooperation problem, where the agents try to find an optimal situation where the benefits 
of pair cooperation (here the Potts couplings) and total sum of the support, which is the 
same for all projects (introduced here as the temperature), is maximized. A phase transition 
occurs in the system between a state when each agents are correlated and a high temperature 
disordered state. I examined this model using a combinatorial optimization algorithm on scale- 
free Barabasi-Albert networks with homogeneous couplings and when the edge weights were 
independent random values following a quasi-continuous distribution with different strength of 
disorder. 

XX j a : As a first point I gave the exact solution of the system for a wide class of evolving 
networks with homogeneous couplings. The phase transition was found to be strictly 
first-order and the critical point was determined through simple theoretical considerations. 

XX jb : By numerical calculations I examined the magnetization curve for different strength of 
disorder and found the theoretically predicted first-order phase transition in the pure case. 
However, the phase transition softened to a continuous one for any strength of disorder 
larger than zero. I examined the structure of the optimal set and I found out its structural 
behaviour was altered by the temperature. 

XX I c : I studied also the critical properties of the system and I calculated the distribution of the 
finite-size critical temperatures for different sizes in case of maximal disorder. I deduced 
by iterative calculations the critical magnetization exponent and I located the critical 
temperature using two independent methods. The scaling of the finite-size transition 
points distribution was characterized by two distinct exponents, that I located and used 
to consider a scaling collapse of the distribution curves. 

XX I d : I also deduced the critical magnetization exponent by two-point fits using the average 
size of the critical cluster. I obtained compatible values with previous results within the 
error of the calculations. 
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The third examined problem was related to the large-g sate random bond Potts model also. 
Here I examined the critical density of clusters which touched a certain border of a perpendicular 
strip like geometry [25]. Following from conformal prediction I expected the same density 
behavior as it was exactly derived for critical percolation in infinite strips [226]. I calculated 
averages by the above mentioned effective combinatorial optimization algorithm and I compared 
the numerical means to the expected theoretical curves. 

XXX /a : During my study I used a bimodal form of disorder for the random couplings, which 
intensity influenced the brcaking-up length of the critical clusters. I allocate an appropri- 
ate value of the strength of the disorder which set the breaking up length large enough 
for relevant measurements but small enough to keep away from the percolation limit. 

XXX jb : First, I examined the critical densities of spanning clusters which touch both bound- 
aries along the strip geometry. I found a good agreement between the predicted conformal 
values and the calculated averages of different linear size. I checked the validity of a com- 
bination of the bulk and surface magnetization exponents coming from scaling predictions 
through the study of the density behaviour close to the boundaries and I found reasonable 
accordance. I also applied a correction close to the boundaries in order to obtain a better 
fit between the calculated and predicted curves. 

XXX I c : Second, I considered the density of the clusters which are touching one boundary of the 
strip. This density is analogous to the order parameter profile in the system with fixed-free 
boundary conditions. This profile close to the fixed boundary was strongly perturbed by 
surface effects, which are due to the presence of the finite breaking up length. However, 
at the free boundaries the density curves approached a scaling curve which sat on the 
predicted conformal function. Close to the fixed boundary I estimated the asymptotic 
behaviour of the scaling curve through extrapolation and I obtained values in agreement 
with the conformal results. 

XXX I d : Finally I considered the density of points in clusters that are touching one of the 
boundaries or both. This density is analogous to the order parameter profile with parallel 
fixed spin boundary conditions. This density profile was found to be strongly perturbed 
by the breaking-up length at both boundaries thus I studied another density which was 
defined on crossing clusters only. However, it was supposed to be related to the same 
operator profile and expected to present the same scaling form. I performed the same 
calculation for percolation also and I found that the numerical and analytical results for 
this type of density profile were in good agreement in both cases. 

The last investigated problem was the antiferromagnetic Ising model on two-dimensional 
triangular lattice at zero temperature in the absence of external field [26]. This model was 
intensively studied during the last few decades, since it shows exotic features in equilibrium 
due to its geometrical frustration. However contradictory explanations were published in the 
literature about its non-equilibrium dynamical behaviour as it was characterized by a diffusive 
growth with logarithmic correction [261] or by a sub-diffusive dynamics with effective exponents 
[262,263]. My aim was to find independent evidences for one of the explanation and examine 
the dynamical behavior in the aging regime. 

XV '/a : To study the non-equilibrium behaviour of the system I introduced a new quantity, 
the non-equilibrium relaxation time t r , which depends only on the dynamics and that is 
capable to determine directly the true value of the dynamical exponent z. The analysis 
of the distribution provided a strong proof for the dynamics in the aging regime to be 
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governed by an exponent z = 2 with logarithmic correction as it was found in related 
problems like the two-dimensional XY model and the fully frustrated Ising model. 

XV /b : Following some recent published methods [50] I also studied numerically the two-time 
autocorrelation function in the equilibrium regime with different waiting times, after 
the system was relaxed into an equilibrated state. Here I found the expected time- 
translational invariant behaviour of the autocorrelation function and I located the same 
dynamical exponent value as above through some exponent combination. 

XV jc : Finally I considered the scaling of the autocorrelation function of different waiting times 
in the aging regime where I used two kind of scaling variables. The one without logarith- 
mic correction did not show a good scaling collapse which suggested that this variable 
choice was inconvenient. However the scaling with a logarithmically corrected variable 
presented an asymptotically good scaling collapse which proved the validity of the loga- 
rithmic corrections during the non-equilibrium dynamics in agreement with the previous 
considerations. 
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Osszefoglalas 



Disszcrtaciomban kiilonbozo komplex sok-test rendszerekben kialakulo kooperatfv viselkcdest 
vizsgaltam skalamcntcs halozatokon cs regularis racsokon. Elsosorban a tanulmanyozott mod- 
click fazisatalakulasa soran mutatott statikus-, cs dinamikus kritikus visclkcdescrc voltam 
kfvancsi a fazisatalakulasi pont kornyeken. Az analitikus szamolasokat nagy pontossagii nu- 
mcrikus szimulaciokbol szarmazott crcdmcnyckkcl vetettem ossze, es a fobb kovetkezteteseket 
referalt tudomanyos folyoiratokban megjelent publikaciokban tettem kozze. Munkam crcdmcnyeit 
a disszertaciomban fejtettem ki, amit a kovetkezokben egy rovid targyi bevezeto utan tezissze- 
rucn foglalok ossze. 

Kooperatfv jelensegek a tudomany szamos tcriilctcn mcgjclcnnck - elsosorban olyan kolcson- 
hato rendszerekben, ahol az egyes egyedck valamilycn optimalis allapot eleresere torekednek, 
es ennek erdekeben hajlamosak az egyiittmukodesre. Ilyen tfpusu visclkedes megngyclhcto 
a gazdasagban, a szociologiaban, a biologiaban vagy fizikai rendszerekben is, ahol ugyan a 
kolcsonhato entitasokat cltcro modon dcfinialjak, de hasonlo korrelatfv viselkedesiik a hatterben 
univerzalis torvenyeket sejtet. Ezen rendszerek eseten a komplexitas az egyszerre jelenlevo 
tenyezok egyiittes hatasakent jelenik meg. Ilyen hatasok lehetnek az egyedek kolcsonhatasat, 
vagy dinamikai viselkedeset lefro torvenyszerusegek, vagy egy kiilso tenyezo befolyasa, esetleg 
a rendszer specialis geometriai struktiirajabol eredo kenyszerek. Az ilyen tenyezok egyiittes 
jelenlete vezet a rendszer komplexitasahoz, es vet fel olyan erdekes kerdeseket, amelyek melyebb 
vizsgalodasra osztonoznek. 

A kooperalo rendszerek hatekonyan vizsgalhatoak a statisztikus fizika kcrctein bcliil. Ezen 
tudomanyag targya olyan jelensegek cs modcllck vizsgalata, ahol a rendszer allapota veletlcn 
valoszmiisegi valtozok fuggvenye, es celja nagyszamii megfigyelesbol szarmazo statisztikai e- 
rcdmenyek alapjan ezen rendszerek megfelelo fizikai leirasa. E targykoron bcliil kicmclkcdo 
figyclmct elvcz a fazisatalakulasok vizsgalata, amely a XX. szazad clejctol fogva valt intenziven 
kutatott teriilette. Ilyen jelensegek szamos helyen elofordulnak a termeszetben, ahol cgymassal 
versengo folyamatok igyekeznek feliihrni a rendszer allapotat egy kiilso parameter fiiggvenyeben. 
A legjobban ismcrt pcldak a folyadek-goz, vagy a ferromagneses-paramagneses atalakulasok, de 
hasonlo viselkedesek figyelhetok meg modell rendszerekben is, mint peldaul kiilonbozo spin- 
modellekben, vagy fertozes terjedesi problemakban valamint kritikus perkolacio eseten. 

A tema egyik elso relevans targyalasa az dtlagter elmelet volt, amely egy szeles korben 
alkalmazhato fenomenologikus kozelftessel szolgalt a fazisatalakulasok es kritikus jelensegek 
mcgcrtcsehcz. Az elmeletet Pierre Weiss definialta eloszor 1907-ben ferromagneses rendszerekre, 
ahol alapotlctkcnt fcltctclczte, hogy a spinek kolcsonhatasa egy atlagterrel helyettesftheto, ami 
minden egyes spinre ugyamigy hat [1]. Ez az lin. molekuldris terkozelites teljes mertekben el- 
hanyagolja a kolcsonhatasi tagban fcllcpo fluktuaciokat, igy kellokepp leegyszeriisftve a problema 
mcgoldasat. Azonban a modell hatranya szinten a fluktuaciok clhanyagolasabol szarmazik, 
miutan fgy alkalmatlan olyan rendszerek kczclcsere, ahol czek hatasa fontos szerepet jatszik. Igy 
cz a modell csak magasabb dimenziqju rendszerekre alkalmazhato, vagy ott, ahol a flukuaciok 
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nem befolyasoljak drasztikusan a rendszer viselkedeset. 

Az egyik legegyszerubb es legelegansabb atlagter targyalas 1936-bol Lev D. Landau-tol szar- 
mazik [2,3]. a termodinamikai potential altalanos alakjabol kiindulva es a rendparameter 
szimmetria tulajdonsagait kihasznalva sikerrel crtelmezte a folytonos fazisatalakulasok soran 
fcllcpo jelensegeket. Feltetelezte, hogy a szabad energia analitikus, es a rendparameter szerint 
sorba fejtheto, ahol csak a rendszer szimmetriajat nem serto tagok jelennek meg. 

Az a megfigyeles, - hogy a kritikus rendszer korrelacios hossza a fazisatalakulasi pont kor- 
nyeken diver gal, es a rendszerben mcgjclcno fluktuaciok onhasonloak a hosszusag skalatol 
fiiggetlcniil - cz vezetett a kritikus rendszerek skalainvarians visclkedesenek fclismercschcz. A 
jelenseg elso atfogo matematikai targyalasat Leo Kadanoff adta [4,5], akinek az eredmenyeit 
fclhasznalva az 1970-es evek elejen Kenneth G. Wilson dolgozta ki a renormalizdcios cso- 
portelmeletet [6,7]. Ez a hipotezis a kfserleti eredmenyekkel egybecsengo elmeleti joslasokkal 
szolgalt, melynek segitsegevel a kritikus rendszerek az oket jellcmzo szingularitasok alapjan 
univerzalitasi osztalyokba sorolhatoak. Ezekert az eredmenyekert Wilson 1982-ben megkapta a 
Nobel-dijat. 

A hetvencs evekben egy masik teoria is napvilagot latott - kiegeszitve a mar korabban 
kidolgozott elmeleti modszereket. A konform terelmeletet Polyakov dcfinialta closzor [8] ki- 
hasznalva, hogy a konform-lckcpczcsek csoportja ekvivalcns a ketdimenzios komplex anali- 
tikus fiiggvenyek csoportjaval [9, 10]. Ezt es a skalainvarians viselkedest fclhasznalva egy kri- 
tikus rendszer allapotosszcgc fclirhato, ami aztan alkalmas a kritikus tulajdonsagok pontos 
meghatarozasara. A konform-lekepezesek soran a rendparameter korrelacios fuggvenye szintcn 
kiszamolhato, amibol kovetkeztethetiink a renparameter profilok alakjara a rendszer hatarai 
mentcn. 

Elso kozclftesben a vizsgalt rendszert homogennck szokas tekinteni, ez nagyban megkonnyfti 
annak vizsgalatat, es fizikai leirasat. Azonban a termeszetben az anyagokra jellemzo nagy- 
foku inhomogenitas is fontos szerepet jatszhat, amikor azok fazisatalakulason mennck keresztiil 
[11]. Erre a legjobb pelda a kristalyokban elofordulo szennyczodesek es racshibak, melyek je- 
lentekcnycn kepesek bcfolyasolni az anyag kritikus viselkedeset. Az elmeleti lefras soran az 
ilyen inhomogenitasokat valamely parametercn dcfinialt vclctlcnszcruseggel szokas bevezetni 
a vizsgalt rendezetlen modellbe. Ilyen random parameter lchet a kolcsonhatas erossege, vagy 
megjelenhet egy a rendszerre hato kiilso terben, vagy pi. dcfinialhato a kolcsonhato reszecskek 
veletlcnszeru hfgftasaval. A rendezetlenseg ilyen fajta bevezetese perturbalhatja a kritikus 
viselkedest, megvaltoztatva a fazisatalakulas rendjet, valamint fcliihrhatja annak kritikus jellcmzoit, 
fgy transzformalva a rendszert egy masik univerzalitasi osztalyba. 

Ezen ki'viil inhomogenitas a rendszer geometriai tulajdonsagaibol is eredhet. A szilardtest 
fizikabol ismert kristalyos szerkezeteken till sok onszervezo halozat a termeszetben veletlcnszeru 
strukturakba fcjlodik. Az ilyen ti'pusii strukturakra az elso rclevans modcllt ket magyar matcm- 
atikus, Erdos Pal es Renyi Alfred definialta, akik az un. veletlen grdf modellben figyelembe 
vettek az elrendezes lehetseges rcndczetlenseget is [12-14]. Az o munkajuk soran fejlodott ki 
a maig szeles korben kutatott halozatok tudomanya. Azonban, a technika clorehaladasaval 
a valos halozatokrol egyre tobb informacio valt clcrhctove, fgy lehetoseg nyflott a hatterben 
meghiizodo valodi rcndezoclvek mcgertesere, ami alapjan egy osszetettebb viselkedes korvon- 
alazodott ki. A kilencvenes evek elejen Barabasi-Albert Laszlo, Albert Reka es Hawoong 
Jeong a vilaghalo strukturajanak vizsgalata soran figyeltek fel arra, hogy a halozat fokeloszlasa 
hatvanyfiiggveny szerint cscng lc, ami alapjan kovetkeztettek a halozat fejlodeseert fclclos 
torvenyszerusegekre [15]. Az altaluk definialt Barabdsi- Albert hdlozati modellben, figyelembe 
vettek, hogy a halozat idoben dinamikusan novekszik, valamint a fcjlodes soran egy un. pre- 
feralt kapcsolodasi szabaly fclclos a rendszer inhomogenitasaert. Ez a ket tulajdonsag egyiittes 
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mcgjclcncsc vczet a kialakulo halozat skalamcntcs visclkcdcschez. Az altaluk felalh'tott modcll 
szcles korben ncpszcriive valt, miutan egyre tobb valos komplex hdlozatban talaltak hasonlo 
struktiirat [16]. Ez a skalamentes tulajdonsag az onszervezo halozatok fcjlodesenel univerzalis 
torvenyszeriisegeket mutat a hatterben, mely intcnzi'ven kutatott teriilct mind mai napig. 

A komplex sok-tcst rendszerek vizsgalata korabban nehezkes volt, mcrt az ilyen tfpusu rendsz- 
erek nagy szabadsagi fokkal rcndelkeznek, fgy rengetek kiilonbozo allapotuk lehetseges. Azon- 
ban a szamftogepek fejlodesevel lehetoseg nyflott nagy forrasigenyii eljarasokat felhasznalva 
a relevans modellek hatekony vizsgalatara. Ez szolgaltatta az alapot egy uj szcmlclctmod, 
a numcrikus fizika kialakulasahoz, mcly az clmult evtizedekben az elmeleti es kiscrlcti tu- 
domanyon ki'viil a fizikai harmadik alappillereve fejlodott. A numerikus modszerek segi'tsegevel 
a kolcsonhato sok-test rendszerek statisztikai vizsgalata is lehetove valt, ez pedig a huszadik 
szazad masodik fclctol kezdve a statisztikus fizika reneszanszahoz vezetett. A statisztikus 
modellek vizsgalatara kifejlesztett numerikus modszereket kozosen Monte Carlo metodusoknak 
nevezziik, mclyek kesobb a fizikan kiviil szamos mas tudomanyagban is alkalmazasra talaltak. 

Az egyik legelso, es legtobbet hasznalt modszer az 1953-ban megjelent un. Metropolis al- 
goritmus [17], amely kolcsonhato spin-rendszerek vizsgalatara alkalmas. Ez a spin-forgato 
algoritmus a rendszert, mint egy Markov folyamatot kezeli, ahol az energia fejlodese csak 
lokalis konfiguraciok fiiggvenye. Ezen tul mas modszerek is lctcznek ilyen tfpusii rendszerek 
vizsgalatara, mint pi. a Wolff, vagy a Swendsen-Wang algoritmusok [18,19], amelyek nem 
egyesevel forgatjak at a spineket, hanem egyszerre teljes domenck iranyat valtoztatjak meg, fgy 
kenyszerftve a rendszert egy gyorsabb idofejlodesre. 

Azonban ezeken kfviil szamos mas olyan statisztikai modszerek leteznek, mclyek szigoru 
matcmatikai eljarasokat kovetvc alkalmasak kiilonbozo fizikai tulajdonsagok, vagy termodi- 
namikai fiiggvenyek pontos meghatarozasara. Ilyen, pi. az az algoritmus, amely a kombina- 
torikus optimalizdcio modszeret felhasznalva alkalmas a szabadenergia egzakt meghatarozasara 
olyan spin modcllckbcn, ahol a szabadenergia, mint szubmoduldris fiiggveny frhato fel [20,21]. 
Egy ilyen iteratfv, erosen polinomialis futasideju algoritmust alkalmaztunk szamos esetben a 
munkank soran. 

Doktori tanulmanyaim fo motivacioja - a fent cmlftctt elmeleti es numcrikus modszerek 
fclhasznalasaval - a kooperatfv viselkedes vizsgalata volt komplex rendszerekben. Munkam 
celja a kolcsonhato sok-reszecske rendszerekben megjeleno fazisatalakulasok es kritikus je- 
lensegek tanulmanyozasa, es azok univerzalis tulajdonsagainak lefrasa volt. Ennek celjabol 
negy kiilonbozo temaban vegeztem kutatasokat, ezek analitikus es numerikus ercdmcnycit dis- 
szertacioban foglaltam ossze a kovetkezo struktiirat kovetve: 

Egy rovid bevezeto utan ismertetem a temahoz kapcsolodo fontosabb elmeleti eredmenyeket. 
Ebben roviden targyalom a fazisatalakulasok es kritikus jclcnscgck tcmakoret, osszefoglaloan 
frok az univerzalitasi osztalyok, es kritikus exponensek elmeletcrcil, majd bevezetem azokat a 
modellekct, melyek kesobb a tezisben a vizsgalatok targyat fogjak kepezni. A fejezet vegen 
roviden bevezetem a rendezetlen rendszerek eseteit, es a hozza kapcsolodo fontosabb elmeleti 
modellekct. A kovetkezo fejezetben eloszor azokat az alapveto grafclmclcti definfeiokat tckin- 
tem at, amelyek sziiksegesek a fejezet egyszeriibb targyalasahoz, majd ezt kovetoen targyalom 
a hasznalt regularis geometriai struktiirakat, es azok tulajdonsagait. Ezt a fcjczctct a kom- 
plex veletlen halozatokba valo rovid bevezetozovel zarom, ahol konkretan az Erdos-Rcnyi, 
Watts-Strogatz es Barabasi-Albert halozati modellekct targyalom rcszlctesebbcn. Az utolso 
bevezeto jcllcgu fejezetben a hasznalt numcrikus modszereket ismertetem. Itt a Monte Carlo 
mctodusok alapotlctcit fcjtem ki, majd az alkalmazott spin algoritmusokkal es kombinatorikus 
optimalizacio modszcrcvel es annak matematikai hatterevel foglalkozom. A fejezetben vegiil a 
Barabasi-Albert halozat generalasara hasznalt sajat metodus keriil definialasra. 
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Ezt az altalanos bcvezetot kovetoen a munkam soran kapott tudomanyos eredmenyek kcriilnck 
ismertetesre, melyeket itt tezispont szeruen ossze is foglalok. 

Elsokcnt a ncmcgycnsiilyi fazisatalakulasokat vizsgaltam skalamentes halozatokban, ahol 
minden elhez a vegpontok fokszamanak hatvanyaval aranyos clsiilyt rcndcltcm [23]. Ez az 
lijraskalazas ligy modosftja a rendszert, hogy a valos esctckhcz hasonloan fazisatalakulas alakul- 
hat ki benne, meg 7 < 3 ertekii fokexponcns csctcn is. A vizsgalt ncmcgycnsiilyi folyamat egy 
reakcio-diffiizio modellek koze tartozo lin. kontaktfolyamat volt, ami az iranyftott perkolacio 
univerzalitasi osztalyba sorolhato. Ez a fertozes terjedesi modcll fazisatalakulast mutat egy 
fertozott-aktiv es egy tiszta-inaktfv fazis kozott a fertozesi es meggyogyulasi valoszfnusegek 
hanyadosanak fiiggvenyeben. A kontaktfolyamat elsiilyozott skalamentes halozatokon valo 
vizsgalatai soran kovetkezo crcdmcnyckre jutottam: 

I/a : Eloszor a rendszer dinamikai atlagter megoldasat adtam meg, melynek segitsegevel sikcriilt 
azonositani a korabbi szamolasokbol vart harom fokcxponcnstol fiiggo kritikus tartomanyt. 
Az elsoben a megadott atlagter mcgoldas maradektalanul teljesiil. A masodik az un. nem- 
konvcncionalis atlagter tartomany, ahol a fazisatalakulas kritikus parameterei 7 fiiggove 
valnak. Vcgiil a harmadik rezsimben nem tortenik fazisatalakulas a rendszerben, mivel 
az mindig az aktfv allapotaban van. 

X/b : Ezek utan a konvencionalis tartomanyban, tcr-clmclcti mcgfontolasok alapjan vizsgaltam 
a rendszer veges-meret skalazasat. Sikeriilt egyszeriien bevezetni a rendszer terfogatat a 
skalafiiggvcnyekbe, ezeket ket alapesetre irtam fel: egyreszt, amikor a fertozes egy atlagos 
fokszamu pontbol indul ki, masreszt, amikor a legjobban osszekotott pontbol terjed szet. 

1/c : A kontakt-folyamat vizsgalatara a konvencionalis atlagter tartomanyban hosszu futasidcju 
numerikus szimulaciokat vegeztem. Sikeriilt lokalizalni a rendszer fazisatalakulasi pontjat, 
es megallapftani a veges-meret kritikus exponcnseket mindket fertozesi esetre. Ezek az 
atlagter ertekekkel jo egyezest mutattak. Szinten kiszamoltam a korrelalt terfogati ex- 
ponenst, ami azonos erteket mutatott mindket esetben, es jo illeszkedett az elmeletbol 
vart crcdmcnyckhcz. Vcgiil rendszer dinamikus skalazasat vizsgaltam a fenti ket esetben, 
ahol egy extrapolacios eljarassal sikeriilt a kapcsolodo dinamikai exponenseket megkapni, 
amelyek ugyan nem voltak azonosak a maximalis es a tipikus fokszamu esetre, de osszee- 
gyeztethetoek voltak az atlagter es veges-meret skalazasbol szarmazo elmeleti ertekekkel. 

Az altalam vizsgalt masodik problema a ferromagneses nagy-q allapotii Potts-modell volt, 
elsiilyozott skalamentes halozatokon [24]. Ez a modcll mcgfcleltcthcto egy olyan optimalis 
kooperacio problemanak, ahol az egyes egyedek a parkolccsonhatasbol (itt a Potts kolcsonhatas) 
es egy kiilso tamogatasbol (esetiinkben a homerseklet) szarmazo beveteleket alapjan probaljak 
megtalalni azt a szamukra optimalis konfiguraciot , amikor a nyercsegiik maximalis. A rend- 
szerben fazisatalakulas jelcnik meg egy korrelalt es egy rendezctlen magas homersekleti fazis 
kozott. Ezt a problemat skalamentes grafokon egy polinomialis idoben megoldhato kombina- 
torikus optimalizacios eljarassal vizsgaltam homogen halozatokon, valamint olyan esetben, ahol 
az clsiilyok egy kvazifolytonos closzlast kovcttck kiilonbozo rcndczctlcnscgi erosseg mcllctt. 

11/a : Elsokcnt fclfrtam a problema egzakt megoldasat homogen esetben - nagyszamii di- 
namikusan fcjlodo halozatra altalanositva. Ekkor a rendszerben vegbemeno fazisatalakulast 
szigoriian elsorendiinek talaltam, ahol cgyszcrii elmeleti mcggondolasok alapjan a kritikus 
pontot is sikeriilt hataroznom. 

TT/b : Szamitogepes szimulaciok segitsegevel is sikeriilt homogen elsiilyozas eseten a fent cm- 
lftett fazis egybeesest reprodukalni. Azonban a rendszer magnesezettseget numcrikusan 
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vizsgalva kitunt, hogy barmilyen erossegii nem-zero rendezetlenseget bevezetve a rend- 
szerben levo fazisatalakulas folytonossa valik. A fazisatalakulas soran tanulmanyoztam 
az optimalis graf szerkezetet is, ahol vizsgalatokbol kitunt, hogy a graf a skalamentes 
struktiirajat egeszen a kritikus homersekletig megtartja, folotte viszont ez teljesen szetesik. 

II I c : Ezen kfviil igyekeztem meghatarozni - maximalis rendezetlenseg mellett - a rendszer 
kritikus parametereit. Iterativ szamolasok segftsegevel sikeriilt megallapitani a kritikus 
magnesezettsegi exponcnst, valamint lokalizalni a fazisatalakulasi pontot ket egymastol 
fiiggctlcn modszer segftsegevel. Eltero meretek eseten szamolt veges-meret kritikus ho- 
merseklctek closzlasa a mcrcsck alapjan ket kiilonbozo exponenssel skalazodott, amikct 
megallapftva a sikeresen skalaztam ossze a kiilonbozo mcrctckhez tartozo eloszlasgorbeket. 

II /d : A kritikus magnesezettsegi exponcnst sikeriilt visszakapnom az atlagos klasztermeretre 
valo ket-pont illesztes segftsegevel. Az fgy kapott ertekek kompatibilisck a font emlftett 
cxponensek ertekeivel. 

A harmadik tanulmanyozott problema szinten a nagy-g allapotii Potts-modclhcz kapcsolodott. 
Ebben az esetben azon kritikus klaszterek siiriiseget vizsgaltam, melyek egy elore meghatarozott 
modon tapadnak ki egy veges atmerojii csfk geometria egyes hatarfchilctcin [25]. Miutan ez a 
rendszer konform-invarianciat mutat a kritikus pontban, ezert hasonlo viselkedest vartunk, 
mint ahogy egy masik konform-invarians rendszerben, a kritikus pcrkolacio eseten korabban 
egzaktul meg lett adva. A vizsgalodasok soran a fenti kombinatorikus optimalizacios algorit- 
must hasznalva a siiruseg profilok atlagat hasonlftottam ossze az elmeletbol szarmazo analitikus 
gorbekkel. 

Ill I a : A vizsgalatok soran a veletlen koteseket bimodalis eloszlas alapjan valasztottam ki. A 
rendezetlenseg erossege erosen befolyasolta a kritikus klaszterek felbontasi hosszat, ezert 
elso lepeskent a rendezetlenseg mcgfclclo intenzitasat kellet megallapitani ugy, hogy a 
felbontasi hossz mcgfclclocn kicsi lcgycn, de a rendszer eleg messze van a perkolacios 
limittol. 

HI /b : Ezt kovetoen azon kritikus klaszterek siiriiseget tanulmanyoztam, amelyek a csfkgeo- 
metria mindket feliiletet erintettek. Kivalo egybccscs mutatkozott az elmeletbol vart es a 
numcrikusan szamolt crcdmcnyck kozott a kiilonbozo linearis meretek eseten. Ezen tul a 
hatarfeliiletek kozcleben a tombi-, es feliileti magnesezettsegi viselkedesbol szarmaztatott 
exponens ervenyesseget is ellenoriztem. A mcgfigyelt viselkedes jol illeszkedett az expo- 
nens alapjan vart algcbrai alakra. Vegiil egy korrekcios tag hatasat vizsgaltam meg, mely 
a feliilctek kozelebcn mcgfclclocn csokkcntcttc a mcrt cs clvart clmclcti crcdmcnyck kozti 
elterest. 

Hljc : Ezek utan azon klaszterek surfiscget elcmcztem, melyck lcgalabb az cgyik hatarfcliilctcn 
kitapadtak. Ez a siiruseg profil megegyezik a rendszer rendparamcter profiljaval rogzftctt- 
szabad hatarfeltetelek mellett. Ezt a profilt a veges felbontasi hosszra visszavezetheto 
feliileti hatasok erosen perturbaltak a rogzftett hatar menten, azonban a szabad hataron 
a surfiscgprofil jol megkozelftettc a josolt analitikus gorbet. A rogzftett hatarhoz kozel 
csak extrapolacioval sikeriilt megbccsiilnom a profil alakjat, de a termodinamikai limitben 
asszimptotikusan jo viselkedest talaltam. 

HI I d : Az utolsokcnt vizsgalt sfirfisegprofil azon klaszterekhez tartozott, amelyek barmclyik 
hatarfcliilctct crintik, fgy vagy mindket oldalon vagy legalabb az egyiken kitapadtak. 
Ez a suriisegprofil a mindket vegen rogzftett rendparamcter profillal ckvivalens. Ezt a 
gorbet mindket vegen erosen befolyasolta a veges felbontasi hossz, fgy egy masik, de 
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ugyanazon rcnparamctcr profilhoz tartozo suriiseget vezettem be az elmeleti eredmcnyck 
ellcnorzcsere. Azonosan clvegezve a szamolast kritikus perkolaciora is, mindket esetbcn 
az eredmcnyck jol illcszkcdtek a konform-anah'tikus gorbekre. 

A negyedik problema az anti-ferromagneses Ising-modcll dinamikai visclkcdcsenek vizsgalata 
volt haromszogracson, zero homerseklctcn, kiilso magneses ter hianyaban [26]. Ez a geome- 
triailag frusztralt modcll cgycnsiilyban erdekes viselkedest mutat, amely cgy igen intcnziven 
vizsgalt tcriilct volt az elmiilt evtizedekben. Azonban a ncmcgycnsiilyi visclkcdcscvcl kapcso- 
latban ellentmondo velemenyek jelentek meg a szakirodalomban. Ket eltero nezopont koziil 
az egyik szerint a dinamika soran a korrclacio az altalanos dinamikai cxponcnsscl jcllcmczhcto 
diffuzrv novckedest mutat, melyhez logaritmikus korrekciok jarulnak. Ezzel szcmbcn a masik 
allftas szerint egy szubdifFiiziv viselkedes jellcmzi a rendszert, amit cffcktiv cxponensekkel 
irhatunk csak le. A vizsgalodasaim celja az volt, hogy a dinamikai viselkedes egy uj tipusu 
vizsgalataval fiiggetlcn bizonyitckokat talaljak valamclyik magyarazathoz. Ezcn kiviil a ncm- 
egyensiilyi tartomany dinamikajanak reszletesebb vizsgalatat tuztem ki magam ele. 

TV I a : A ncmcgycnsiilyi viselkedes vizsgalatara egy uj mennyiseget definialtam, a t r nem- 
egyensiilyi rclaxacios idot, ami tisztan a rcndszer dinamikajatol fiigg, es alkalmas a z 
dinamikai exponens kozvetlcn meghatarozasara. Ezen relaxacios ido eloszlasat vizsgalva 
kiilonbozo meretu rendszerekre, meggyozo bizonyitckokat talaltam a diffiiziv viselkedest 
lciro z = 2 exponens mcllctt, amihez egy logaritmikus korrckcio adodott - hasonlokcppcn, 
mint az azonos kritikus viselkedest mutato XY modellben, valamint a teljesen frusztralt 
Ising-modell esetcn. 

XV /b : Mas hasonlo modelleken elvegzett vizsgalati modszerek alapjan tanulmanyoztam az au- 
tokorrclacios fiiggvenyt kiilonbozo varakozasi idok mcllctt, miutan a rcndszer rclaxalodott 
egy egyensiilyi alapallapotba. Az ilyen tipusu dinamikat jellemzo ido-transzlacios viselkedesen 
tul sikcriilt lokalizalni az egyensiilyi dinamikai exponenst, amely szintcn az clozo pontban 
cmlftctt erteket adta vissza. 

IV I c : Vegiil a nemegyensiilyi autokorrelacios fiiggveny skalazasat tanulmanyoztam a kiilon- 
bozo varakozasi idok escteben, ket kiilonbozo skalazasi valtozot hasznalva. Az elso, loga- 
ritmikus korrekcioktol mentes valtozoval tortent bchclyettesftes nem vczctctt scmmilycn 
relevans egybeeseshez a skalazas soran, ebbol arra kovetkeztethettem, hogy a rendszer 
valojaban nem ezzel a valtozoval skalazodik. Ezzel szemben a logaritmikus korrckciokat 
tartalmazo skalazasi valtozo asszimptotikusan jo osszeskalazast mutatott, mely szintcn 
a korabbi mcgallapitasainkat tamasztotta ala, miszerint a rendszert a ncmcgycnsiilyi 
fazisban egy diffiiziv dinamika jellcmzi, additiv logaritmikus korrckciokkal. 
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Durant ma these, j'ai etudie le comportement cooperatif dans diffcrcnts types de systemes 
complexes a N corps sur des structures rcgulieres et sur des rcscaux sans echcllc dc longueur. 
Je me suis interesse a leur comportement critique statique et dynamique pres de leur transition 
de phase. J'ai effectue des calculs de haute performance en utilisant des methodes numeriques 
recentes, afin de caracteriser, a travers des moyennes numeriques, les proprietes critiques de ces 
systemes. Apres une courte introduction au sujet, je passerai en revue brievement les principaux 
resultats que j'ai obtenus dans quatre sujets. 

Le phenomene cooperatif se manifeste dans diffcrcnts domaines de la science, ou les entites, 
qui interagissent, essaient de satisfaire certaines conditions optimales. De tel comportement sont 
observables en sociologie, economie, biologie ou physique etc.. . . , ou les agents interagissants 
sont dcfinis diffcrcmmcnt, mais ou leur comportement presente des attributs universels. En ce 
sens la complexite du systeme peut etre definie par ses caractcristiques interconnectees resultant 
des proprietes de ses parties individuelles. De telles parties peuvent aussi bien etre celles qui 
gouvernent les interactions que les regies dynamiques controlant revolution dans le temps, ou 
encore le contexte qui peut egalcmcnt influcncer le comportement du systeme. Ce genre d'effets 
combines mcnc a un systeme complexe avec un comportement cooperatif non trivial et souleve 
de nombreuses interessantes questions qui sont le moteur d'etudes avancees. 

Les systemes corrclcs peuvent etre examines efficacemcnt dans le cadre de la physique statis- 
tique. Le sujet de ce domaine est d'etudier les systemes qui dependent de variables aleatoires, 
et decrit leur comportement obtenu d'un grand nombre d'observations utilisant la terminologic 
de la physique. Un sujet interessant de cette branchc est cclui des transitions de phase qui a ete 
intensement etudie depuis le debut du XX eme siecle. Les transitions de phase apparaissent dans 
de nombreuses parties de la Nature ou la competition entre differents processus, controlce par 
un parametre exterieur, determine l'etat du systeme. Les exemples les plus connus en physique 
sont la vaporisation, les transitions paramagnctique/ferromagnctique, mais des comportements 
similaires peuvent etre observes dans des systemes modcles tels que dans diffcrcnts modcles de 
spin, dans des problemcs epidemiques etendus ou dans la percolation critique. 

La premiere approche pertinente fut la theorie de champ moyen qui donne une description 
phcnomcnologique des transitions de phase, du phenomene critique et est en mesure de decrire 
une grande gamme des systemes modeles. Cela a tout d'abord ete defini par Pierre Weiss en 1907 
pour des systemes ferromagnctiques ou il a determine que les spins interagissent entre eux grace 
a un champ moleculaire, proportionnel a une aimantation moyenne [1]. Cette mcthode d'ap- 
proximation du champ moleculaire neglige les interactions entre les particulcs individuelles en 
les remplacent par un champ moyen effectif, ce qui permet de simplificr la solution du problcmc. 
Dans le meme temps l'inconvenient de cette methode provient egalement du champ moleculaire 
moyen, puisqu'il neglige toute sorte de fluctuations dans le systeme. Done 1' approximation de 
champ moyen est valide seulement dans les systemes a grande dimension ou en cas de modclc 
a faiblc fluctuations. 
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L'une des plus simples et plus elegantes speculations de champ moyen, conccrnant la forme 
possible generale d'une potentielle thermodynamique proche du point critique, a ete intro- 
duce par Lev. D. Landau en 1936 [2, 3]. La theorie de Landau permet une reproduction 
phcnomcnologiquc des transitions de phase continues basee sur la symetrie du parametre 
d'ordre. II a demontre que l'energie libre est une fonction analytique et qu'elle peut s'etendre 
a des series de puissance du parametre d'ordre oil les seuls termes qui contribuent sont ceux 
compatibles avec la symetrie du systeme. 

L'observation du fait que la longueur de la correlation diverge au seuil de la transition de 
phase et que les fluctuations dans le systeme sont les memes tout a toute l'echelle amene a 
la reconnaissance d'un comportcment invariant d'echelle des systemes critiques. La premiere 
approchc mathematique d'un tel phenomcne a etc faite par Leo Kadanoff dans les annees 
60 [4,5]. Quelques annees plus tard au debut des annees 70, base sur ces resultats, Kenneth G. 
Wilson, a engage un debat sur ce sujet, dans ses celebres ecrits [6,7]. II a introduit la theorie 
du groupe de renormalisation qui a produit les predictions a propos du comportcment critique 
en accord avec les resultats experimentaux et a donne la possibilite de classifier les systemes 
critiques en classe d'universalite, du fait de leur comportement singulier. Ses recherches ont ete 
recompensees par le prix Nobel en 1982. 

Au debut des annees 70 une autre theorie emerge et complete les connaissances concernant 
le comportement universel autour des phenomenes critique. La theorie conforme a d'abord ete 
proposee par Polyakov [8], qui a tire benefice du fait que le groupe des applications conformes 
est equivalent au groupe des fonctions complexes analytiques en deux dimensions [9,10]. En 
cxploitant cette propriete et l'invariance d'echelle, la fonction de partition du systeme critique 
est calculable cc qui amene a un calcul exact des exposants critiques. Dans le cas de transfor- 
mations conformes, la fonction correlation du parametre d'ordre peut etre egalcmcnt calculee 
ce qui permet de deduirc le profile du parametre d'ordre le long des bords du systeme. 

En premiere approximation, le systeme examine est generalement suppose homogene, cette 
condition simplifie son etude et sa description physique. Toutefois dans la nature, une sub- 
stance est souvent caracterisee par un certain degre d'inhomogeneite, qui peut perturber son 
comportement critique [11]. De frequents exemples etablis de cette anormalite sont les defauts 
et les impuretes dans les cristaux. Dans une description thcoriquc ce genre de caracteristiquc 
est introduit par le concept de desordre qui est defini par des valeurs aleatoires distributes sui- 
vant une certaine loi, caracteristique du modele desordonne examine. Ces proprietes aleatoires 
sont capables aussi bien de modifier les caracteristiques critiques d'un systeme que de changer 
l'ordre de la transition de phase ou de modifier le point critique et les exposants, ce qui range 
alors le modele dans une nouvelle classe d'universalite. 

Toutefois, l'inhomogcncitc peut aussi provenir egalement de la structure geomctrique du 
materiel de base. Au-dela de la physique du solidc, oil les cristaux ont une geometric reguliere, de 
nombreux milieux auto-organises dans la nature peuvent former des structures aleatoires. Deux 
mathematiciens hongrois, Pal Erdos et Alfred Renyi ont defini lc l cr modele graphe aleatoire 
connu dans leurs papiers pionniers au debut des annees 60, ce qui s'est avere etre l'originc 
de la nouvelle science des reseaux [12-14]. Toutefois, comme les informations des reseaux du 
monde reel devinrent accessibles grace a rcmcrgcncc de vastes bases de donnees, une attention 
particuliere aux principes organisateurs et implicites a suggere une structure plus complexe. Au 
debut des annees 90 Barabasi, Albert et Jcong, apres avoir examine la structure du «World Wide 
Web», ont trouve une decroissance algebrique de la distribution des degres. Cette observation les 
a fait realiser la veritable regie qui gouverne revolution de ce genre de reseau complexe [15]. lis 
ont defini un modele de reseau dynamique croissant, le modele Barabasi- Albert, ou les sites sont 
connectes de fagon homogene mais suivent une regie d'attachement preferentiel conduisant a un 
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graphe sans echelle avec une loi de puissance dc la distribution des degres. Ce modclc donna une 
tres bonne approximation des reseaux complexes reels et est devenu populaire apres que l'on 
ait trouve que beaucoup de systemes complexes en science presente la mcmc structure [16]. Ce 
comportcmcnt, observe dans plusicurs disciplines, qui suggere des regies universcllcs derriere les 
reseaux auto-organises porte cette discipline en premiere lignc dc la science jusqu'a aujourd'hui. 

Analyser un systeme complcxe a N corps etait difficile autrefois, puisque generalement ces 
systemes ont beaucoup de degres de liberte et que ces derniers peuvent etre dans de nombreux 
etats possibles. Toutcfois grace a l'amelioration des moyens de calculs de nouvelles possibilitcs 
sont apparues et des methodes numeriques de haute precision ont ete developpees pour exami- 
ner les modeles pertinents. Cela a ete a la base de la nouvelle discipline physique numcriquc, 
qui ensuite devint lc 3 cmo pilier de la science apres les experiences et la theorie. En utilisant 
les calculs numeriques, la description de systeme a N corps devint accessible ce qui a amene 
a la renaissance de la physique statistique. Cette relation induit revaluation des methodes 
Monte-Carlo qui ont fourni des techniques speciales de calculs pour les simulations de physique 
statistiques. 

L'une des leres, et des plus utilisees, methodes, qui soit capable dc simuler des systemes spins 
interagissant, est V algorithme Metropolis, introduit en 1953 [17]. Cet algorithme de retournement 
a un spin fait evoluer le systeme, a travers une chaine Markov ou le changement d'energie du 
systeme depend des configurations locales. Toutefois, d'autres algorithmes, celui de Swendsen- 
Wang et celui de Wolff [18, 19], fournissent des methodes plus efficaces ou au lieu de retourner 
un seul spin, des domaines complets sont retournes en une etape et conduise plus vite le systeme 
vers l'equilibre. 

Au-dcla de cela, de nombreux autres genres de methodes statistiques ont ete developpes afin 
de calculer certaines fonctions thermodynamiques en utilisant des considerations mathematiques. 
Un recent algorithme qui utilise l'optimisation combinatoire, est capable de calculer exacte- 
ment l'energie libre pour des modeles ou la fonction energie libre est une fonction submodu- 
laire [20,21]. Cette methode iterative, qui fournit des resultats en un temps fortement polyno- 
mial, a ete appliquee frcquemment au cours de mon travail. 

Ma motivation lors de mon doctorat fut d'examiner le comportement cooperatif dans des 
systemes complexes en utilisant les methodes prccedcmmcnt mcntionnccs, dc la physique sta- 
tistique et de l'informatique. Le but de mon travail fut d'etudicr le comportement critique 
des systemes a N corps durant leurs transitions de phase et de decrire de fagon analytiquc 
leurs caracteristiques universelles, au moyen de calculs numeriques. Afin d'y arriver j'ai effectue 
des etudes dans quatre sujets differents qui sont presentes dans la dissertation de la maniere 
suivante : 

Apres une breve introduction, j'ai resume les points capitaux en relation avec les resultats 
theoriques. J'ai brievement aborde le sujet des transitions de phase et des phenomenes critiques, 
de meme que la theorie des classes d'universalite et des exposants critiques. Ensuite j'ai introduit 
les modeles statistiques important qui sont examines plus tard dans la these et j'ai donne une 
petite description des modeles desordonnes. Dans le chapitre suivant, j'ai tout d'abord mis en 
avant les definitions de la theorie des graphes dont j'ai eu besoin pour introduire les structures 
gcomctriques appliquccs et j'ai passe en revue les principales proprietes des reseaux regulieres et 
j'ai defini les conditions de bord generalement utilisees. J'ai termine ce chapitre avec une petite 
introduction sur les reseaux complexes. Le chapitre suivant contient les methodes numeriques 
appliquccs que j'ai utilisees au cours des etudes numeriques. J'ai ecrit quelques mots sur les 
methodes de Monte-Carlo et j'ai introduit l'algorithme d 'optimisation combinatoire utilise, et 
ses justifications mathematiques. Pour terminer j'ai decrit mes propres techniques pour generer 
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des reseaux sans cchcllc . 

Suite a cette introduction theorique les resultats scientifiques ont ete presentes de la maniere 
suivante : 

Le l cr sujet auquel je me suis interesse est une etude des transitions de phase hors equilibrc 
dans les reseaux sans echelle de longueur, oil la distribution des connectivity etait ajustee, de 
telle fagon qu'une transition de phase puisse etre rcaliscc mcmc dans les reseaux realistes ayant 
un degre exposant 7 < 3 [23]. Lc systcmc hors cquilibre etudie etait le « contact process » qui est 
un modele de reaction-diffusion appartenant a la classe d'universalite de la percolation dirige. 

I/a : Tout d'abord j'ai donne la solution de champ moyen dynamique du modele dans les 
reseaux sans cchcllc et j'ai localise les trois regimes critiques connus auparavant. Le l er 
regime est celui oil le comportement de champ moyen est conventionnel. Ensuite cette 
solution devient non conventionnelle puisque les proprietes critiques sont dependantes de 
7. Dans le 3 emc regime, le systeme est toujours dans une phase active. 

X/b : J'ai egalement fait quelqucs considerations theoriques afin de gencraliscr les recents resultats 
de theorie des champs a propos des echelles de taillc finic, qui sont censees etre valide au- 
dessus de la dimension critique superieure, autrement dit dans lc regime de champ moyen 
conventionnel. J'ai introduit de maniere simple le volume du reseau dans les fonctions 
echelles que j'ai derivees dans les deux cas, ou l'infection est initie soit par un site typiquc 
connecte, soit par le vertex le plus connecte du reseau. 

I/c : J'ai execute des simulations numeriques de haute performance afin de stimuler le processus 
contact dans lc regime de champ moyen conventionnel. J'ai localise le seuil de transition 
de phase et j'ai calcule les exposants de taille finie pour lc site connecte maximal et 
typique que j'ai trouve en accord avec les predictions de theorie des champs. J'ai egalement 
determine l'cxposant du volume corrclc qui s'est avere egal dans les deux cas et compatible 
avec les predictions theoriques. Finalement j'ai analyse le «scaling» dynamique du systcmc 
au point critique pour les deux cas mentionne ci-dessus. A l'aide d'extrapolations j'ai 
montre que les exposants relies aux deux cas ci-dessus (site typique ou maximalemcnt 
connecte) etaient differents mais compatible avec les predictions de champ moyen et de 
loi d'echelle en taille finie. 

Le dcuxicmc problcme que j'ai etudie fut le modele de Potts alcatoirc fcrromagnctique avec 
de grandes valeurs de q sur des reseaux evolutifs sans echclle [24] . Ce problcme est equivalent a 
un probleme de cooperation optimale, oil les agents essaient de trouver une situation optimale, 
oil les benefices de cooperation de paire (ici les couplages de Potts) et la somme totale du 
support, qui est la meme pour tous les projets (introduite ici comme la temperature), sont 
maximises. Une transition de phase apparait dans le systeme entre un etat ou tous les agents 
sont correles, et un etat desordonne a haute temperature. J'ai examine ce modele en utilisant 
un algorithme d'optimisation combinatoire sur les reseaux de Barabasi-Albcrt sans cchcllc de 
longueur avec des couplages homogenes et aussi avec des couplages ponderes par des variables 
aleatoires independantes, suivant une distribution quasi-continue avec differents intensite de 
desordre. 

XX I a : Tout d'abord j'ai donne la solution exacte du systeme pour une large classe de reseaux 
evoluant avec des couplages homogenes. La transition de phase s'est averee etre du premier 
ordre et le point critique a ete determine par simples considerations theoriques. 

XX /b : Grace a des calculs numeriques j'ai examine la courbe d'aimantation pour diffcrentcs 
intensites du desordre et j'ai trouve la transition de phase predite theoriqucment dans le 
cas pur. Toutcfois la transition de phase devient du dcuxicmc ordre pour n'importe quel 
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desordre non mil. J'ai examine la structure de l'ensemble optimal et j'ai trouve qu'elle 
etait modificc lorsquc la temperature variait. 

XX /c : J'ai ctudic cgalcmcnt les proprietcs critiques du systemc et j'ai calcule la distribution des 
temperatures critiques de taille finie pour diffcrentes tailles en cas de desordre maximal. 
J'ai deduit par des calculs iteratifs l'exposant critique d'aimantation et j'ai localise la 
temperature critique en utilisant deux methodes indcpcndantcs. La loi d'cchcllc en taille 
fine pour la distribution des temperatures de transition est caracterisee par deux exposants 
distincts que j'ai determines et utilises pour verifier que ccs courbes des distributions 
de temperatures critiques sc ramcnaicnt toutes a une courbe unique si Ton utilisait les 
variables reduites. 

II I d : J'ai cgalcmcnt deduit l'exposant critique d'aimantation par un ajustcmcnt a deux points 
en utilisant la taille moyenne de l'amas critique. J'ai obtenu des valeurs compatibles avec 
les resultats precedents en tenant compte des arrondis de calculs. 

Lc troisicmc problcmc examine fut en rapport cgalcmcnt avec lc modcle de Potts ferro- 
magnctique aleatoire a grand nombre d'etats [25]. J'ai examine la densite critique des amas 
qui touchent l'un ou l'autre des bords dans une geometric rcctangulairc. Conformcmcnt a une 
prediction de la theorie conforme je me suis attendu au meme comportement que celui derive 
exactement pour la percolation critique dans des bandes infinies [226]. J'ai calcule des moyennes 
a l'aide de l'algorithme d' optimisation combinatoire mentionne ci-dessus et j'ai compare les 
moyennes numeriques aux courbes thcoriqucs attendues. 

Ill I a : Au cours de cette etude j'ai utilise une forme bimodale pour la distribution des cou- 
plages aleatoires, dont l'intensite controle la longueur de brisurc des amas critiques. J'ai 
choisi une valeur appropriee de l'intensite du desordre pour la longueur de brisure des 
amas critiques soit suffisamment courte mais en evitant la limite de percolation. 

Ill/b : Tout d'abord j'ai examine les densites critiques des amas qui touchent les deux lon- 
gueurs du rcscau rcctangulairc. J'ai trouve une bonne concordance entre les valeurs 
predites par les theories conformes et les moyennes calculees pour difierentes tailles. J'ai 
verifie la validite de la combinaison de l'exposant d'aimantation «bulk» et de l'exposant 
d'aimantation de surface predite par les lois d'echelle, par l'etude du comportement de la 
densite pres des bords et j'ai trouve une concordance raisonnablc. J'ai cgalcmcnt applique 
une correction pres des bords afin d'obtenir une mcillcurc adequation entre les courbes 
predites et calculees. 

Ill I c : En second, j'ai considere la densite des amas qui touche l'un des bords de la bande. 
Cette densite est analogue au profile du parametre d'ordre dans le systeme avec des 
conditions de bords fixe-libre. Ce profile pres des bords fixes est fortement perturbe par 
les effcts de surface, qui sont dus a la longueur de brisurc des amas. Toutcfois aux bords 
librcs les courbes de densite s'approche de la fonction predite par la theorie conforme. 
Pres du bord fixe, j'ai estime le comportement asymptotique de la courbe a echelle en 
extrapolant et j'ai obtenu des valeurs en accord avec les resultats des theories conformes. 

XXX Id : Finalemcnt j'ai considere la densite des points des amas qui touchent un des bords ou 
les deux. Cette densite est analogue au profile du parametre d'ordre avec des conditions de 
bord fixe. Ce profile de densite s'est trouve fortement perturbe par la longueur de brisure 
des amas aux deux bords, e'est pourquoi j'ai etudie une autre densite definie uniquemcnt 
pour les amas traversant l'echantillon. On suppose que la meme forme d'cchcllc s'appliquc 
aux deux cas. J'ai cgalcmcnt accompli lc meme calcul pour le problcme de la percolation 
et j'ai trouve que les resultats numeriques et analytiques pour ce type de profil de densite 
sont en concordance dans les deux cas. 



xxxiv 



RESUME 



Lc dernier problcme que j'ai etudie fut le modele antifcrromagnctiquc d'Ising bidimcnsionncl 
sur rcscau triangulairc a temperature zero en l'absence de champ exterieur [26]. Ce modele 
a ete intensement etudie au cours des deux dcrnieres decennies, dans la mesure ou il montre 
les caracteristiques exotiques a l'equilibre due a la frustration gcomctriquc. Ccpcndant des 
explications contradictoires ont ete publiees dans la litterature a propos du comportement 
dynamique en hors equilibre, suivant qu'il ctait caracterise par une croissance diffusive avec 
correction logarithmique [261] ou par une dynamique sous diffusives avec des exposants effectifs 
[262,263]. Mon but fut de trouver des preuves independantes pour l'une des explications et 
d'examincr lc comportement dynamique dans le regime de vicillisscmcnt. 

IV I a : Pour ctudicr lc comportement en hors equilibre du systeme j'ai introduit une nouvelle 
quantitc de temps de relaxation hors-equilibre t r , qui depend uniqucmcnt de la dynamique 
et qui est capable de determiner directement la vraie valeur de l'exposant dynamique z. 
L'analyse de la distribution fournit une preuve forte que les dynamiques dans le regime 
de vieillissement sont regies par un exposant z — 2 avec correction logarithmique, tel que 
cela a ete trouve aussi dans des problemes relies telsque le modele XY bidimensionnel et 
le modele d'Ising completement frustre. 

TV /b : D'apres des methodes recemment publiees [50], j'ai cgalcmcnt etudie numcriqucmcnt la 
fonction d'auto correlation a deux temps dans lc regime d'cquilibre avec differents temps 
d'attente, apres que le systeme soit relaxe dans un etat d'equilibrc. J'ai ainsi trouve le 
comportement attendu d'invariance par translation de la fonction d'auto correlation et 
j'ai retrouve meme valeur de l'exposant dynamique que ci-dessus, mais a travers une 
combinaison d'exposants. 

IV I c : Finalcment j'ai considcrc lc comportement d'cchcllc de la fonction d'auto correlation 
apres differents temps d'attente dans le regime de vieillissement ou j'ai utilise les deux 
types de variables d'echelle introduits plus haut. La variable d'echelle sans correction lo- 
garithmique n'a pas montre de courbe universelle, ce qui suggera que ce choix ne convient 
pas. Cependant la variable logarithmiqucmcnt corrigee a bien prcsente une courbe uni- 
verselle ce qui prouva la validite des corrections logarithmiques lors des dynamiques hors 
cquilibrees en accord avec les considerations precedentes. 
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